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Abstract.  This  paper  addresses  the  problem  of  steering  a  group  of  vehicles  along  given  spa¬ 
tial  paths  while  holding  a  desired  time-varying  geometrical  formation  pattern.  The  solution  to  this 
problem,  henceforth  referred  to  as  the  coordinated  path- following  (CPF)  problem,  unfolds  in  two 
basic  steps.  First,  a  path- following  (PF)  control  law  is  designed  to  drive  each  vehicle  to  its  assigned 
path,  with  a  nominal  speed  profile  that  may  be  path  dependent.  This  is  done  by  making  each  vehicle 
approach  a  virtual  target  that  moves  along  the  path  according  to  a  conveniently  defined  dynamic 
law.  In  the  second  step,  the  speeds  of  the  virtual  targets  (also  called  coordination  states)  are  ad¬ 
justed  about  their  nominal  values  so  as  to  synchronize  their  positions  and  achieve,  indirectly,  vehicle 
coordination.  In  the  problem  formulation,  it  is  explicitly  considered  that  each  vehicle  transmits 
its  coordination  state  to  a  subset  of  the  other  vehicles  only,  as  determined  by  the  communications 
topology  adopted.  It  is  shown  that  the  system  that  is  obtained  by  putting  together  the  PF  and 
coordination  subsystems  can  be  naturally  viewed  as  either  the  feedback  or  the  cascade  connection 
of  the  latter  two.  Using  this  fact  and  recent  results  from  nonlinear  systems  and  graph  theory,  con¬ 
ditions  are  derived  under  which  the  PF  and  the  coordination  errors  are  driven  to  a  neighborhood 
of  zero  in  the  presence  of  communication  losses  and  time  delays.  Two  different  situations  are  con¬ 
sidered.  The  first  captures  the  case  where  the  communication  graph  is  alternately  connected  and 
disconnected  (brief  connectivity  losses).  The  second  reflects  an  operational  scenario  where  the  union 
of  the  communication  graphs  over  uniform  intervals  of  time  remains  connected  (uniformly  connected 
in  mean).  To  better  root  the  paper  in  a  nontrivial  design  example,  a  CPF  algorithm  is  derived  for 
multiple  underactuated  autonomous  underwater  vehicles  (AUVs).  Simulation  results  are  presented 
and  discussed. 
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1.  Introduction.  Increasingly  challenging  mission  scenarios  and  the  advent  of 
powerful  embedded  systems,  sensors,  and  communication  networks  have  spawned 
widespread  interest  in  the  problem  of  coordinated  motion  control  of  multiple  autono¬ 
mous  vehicles.  The  types  of  applications  considered  are  numerous  and  include  aircraft 
and  spacecraft  formation  control  [6],  [23],  [29],  [36],  [39],  [49],  [50],  [60],  [30],  [4],  [64], 
coordinated  control  of  land  robots  [16],  [52],  [22],  [58],  control  of  multiple  surface  and 
underwater  vehicles  [17],  [26],  [34],  [63],  [13],  and  networked  control  of  robotic  systems 
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[15],  [14],  [33],  [41],  [37],  [43],  [48].  To  meet  the  requirements  imposed  by  these  and 
related  applications,  a  new  control  paradigm  is  needed  that  must  necessarily  depart 
from  classical  centralized  control  strategies.  Centralized  controllers  deal  with  systems 
in  which  a  single  controller  possesses  all  the  information  required  to  achieve  desired 
control  objectives,  including  stability  and  performance  requirements.  In  many  of  the 
applications  envisioned,  however,  the  highly  distributed  nature  of  the  vehicles’  sensing 
and  actuation  modules  and  the  constraints  imposed  by  the  intervehicle  communica¬ 
tion  network  make  it  impossible  to  tackle  the  problems  in  the  framework  of  centralized 
control  theory.  In  part  due  to  these  reasons,  there  has  been  over  the  past  few  years  a 
flurry  of  activity  in  the  area  of  multiagent  networks  with  application  to  engineering 
and  science  problems.  The  list  of  related  research  topics  is  vast  and  includes  paral¬ 
lel  and  distributed  computing  [7],  distributed  decision  making  [61],  synchronization 
in  oscillator  networks  [46],  flocking  of  mobile  autonomous  agents  [5],  [18],  [28],  [54], 
state  agreement  and  consensus  problems  [20],  [38],  [51],  [40],  [44],  [42],  [11],  asyn¬ 
chronous  consensus  protocols  [9],  [61],  graph  theory  and  graph  connectivity  [45],  [56], 
[32],  rigidity  and  persistence  in  autonomous  formations  [62],  adaptive  and  distributed 
coordination  algorithms  for  mobile  sensing  networks  [12],  [11],  and  concurrent  syn¬ 
chronization  in  dynamic  system  networks  [48] .  See  also  [55]  and  the  references  therein 
for  general  expositions  on  large-scale  dynamical  systems  and  decentralized  control  of 
complex  systems  that  bear  affinity  with  the  issues  addressed  in  this  paper. 

In  spite  of  significant  progress  made  in  these  areas,  much  work  remains  to  be  done 
to  develop  strategies  capable  of  yielding  robust  performance  of  a  fleet  of  vehicles  in  the 
presence  of  complex  vehicle  dynamics,  severe  communication  constraints,  and  partial 
vehicle  failures.  These  difficulties  are  especially  challenging  in  the  field  of  marine 
robotics  for  two  main  reasons:  (i)  often,  the  dynamics  of  marine  vehicles  cannot  be 
greatly  simplified  for  control  design  purposes;  and  (ii)  underwater  communications 
and  positioning  rely  heavily  on  acoustic  systems,  which  are  plagued  with  intermittent 
failures,  latency,  and  multipath  effects. 

Inspired  by  recent  theoretical  and  practical  developments  in  the  areas  of  multiple 
vehicle  control,  we  consider  the  problem  of  coordinated  path-following  ( CPF)  control, 
where  multiple  vehicles  are  required  to  follow  prespecified  paths  while  keeping  a  desired, 
possibly  time-varying,  geometric  formation  pattern.  These  objectives  must  be  met  in 
the  presence  of  communication  losses  and  delays.  The  problem  arises,  for  example,  in 
the  operation  of  multiple  autonomous  underwater  vehicles  (AUVs)  for  fast  acoustic 
coverage  of  the  seabed  [47].  In  this  application,  two  or  more  vehicles  maneuver  above 
the  seabed,  at  either  the  same  or  different  depths,  along  geometrically  similar  spatial 
paths  and  map  the  seabed  using  identical  suites  of  acoustic  sensors.  By  requesting 
that  the  vehicles  move  along  the  paths  so  that  the  projections  of  the  acoustic  beams  on 
the  seabed  have  a  certain  degree  of  overlapping,  large  areas  can  be  mapped  in  a  short 
time.  These  objectives  impose  strict  constraints  on  the  vehicle  formation  pattern. 

A  number  of  other  scenarios  can  be  envisioned  that  require  CPF  control  of  marine 
vehicles.  Examples  include  underwater  vehicle  formation  control  for  3D  vision-based 
marine  habitat  mapping,  ship  underway  replenishment  [34],  and  missions  where  tem¬ 
poral  and  spatial  path  deconfliction  are  critical  [30] .  Similar  problems  arise  in  the  area 
of  air  vehicle  control.  All  of  these  scenarios  share  the  requirements  that  a  number  of 
vehicles  maneuver  along  predetermined  paths,  at  nominal  speed  profiles  that  may  be 
path  dependent,  and  keep  a  possibly  time-varying  formation  pattern.  Absolute  time 
requirements  are  not  part  of  the  problem.  As  such,  they  depart  considerably  from 
other  related  problems  such  as  vehicle  rendezvous  maneuvers  and  swarm  formation 
control.  The  manner  in  which  the  paths  and  the  formation  are  planned  depend  on 
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the  specific  problem  at  hand,  for  example,  using  a  time  optimality  criterion  when  fast 
coordinated  maneuvering  between  initial  and  final  positions  is  required,  minimizing 
an  energy-related  criterion  when  the  objective  is  to  scan  a  certain  area  or  volume 
densely  and  energy  is  at  a  premium,  or  using  a  combination  of  criteria  that  include 
geometric  constraints  when  collision  avoidance  is  important.  See,  for  example,  [30] 
for  the  case  of  unmanned  air  vehicles. 

In  this  paper  we  formulate  and  solve  the  problem  of  CPF  by  explicitly  taking 
into  account  the  vehicle  dynamics  and  the  topology  of  the  underlying  communication 
network,  subject  to  communication  losses  and  delays.  The  reader  is  referred  to  [17], 
[21],  [22],  [35],  [58]  and  the  references  therein  for  a  historical  overview  of  the  topic  and  a 
perspective  of  the  sequence  of  motion  control  problem  formulations  and  solutions  upon 
which  the  present  work  builds.  See  also  [19],  [57],  [47]  for  an  in-depth  introductory 
exposition  to  the  topic  at  hand.  For  the  sake  of  clarity,  it  is  important  to  point  out  that 
in  the  scope  of  the  problem  at  hand,  PF  and  CPF  have  also  been  referred  to  as  output 
maneuvering  and  synchronization  of  multiple  maneuvering  systems,  respectively  [58]. 
A  comprehensive  survey  of  related  results  on  consensus  in  multivehicle  cooperative 
control  can  be  found  in  [42],  [44],  and  [51]. 

The  solution  to  the  problem  of  CPF  that  we  propose  unfolds  in  two  basic  steps. 
First,  a  PF  control  law  is  designed  to  drive  each  vehicle  to  its  assigned  path,  with 
a  nominal  speed  profile  that  may  be  path  dependent.  This  is  done  by  making  each 
vehicle  approach  a  virtual  target  that  moves  along  the  path  according  to  a  conveniently 
defined  dynamic  law.  Each  vehicle  has  access  to  a  set  of  local  measurements  only.  In 
the  second  step,  the  speeds  of  the  virtual  targets  (also  called  coordination  states)  are 
adjusted  about  their  nominal  values  so  as  to  synchronize  their  positions  and  achieve, 
indirectly,  vehicle  coordination.  The  vehicles  are  allowed  to  exchange  only  limited 
information  with  their  immediate  neighbors.  Without  being  too  rigorous,  it  can  be 
said  that  the  strategy  proposed  abides  by  a  separation  principle  whereby  the  PF  and 
coordinated  motion  control  designs  are  almost  decoupled.  This  simplifies  the  overall 
design  process.  Furthermore,  it  has  the  virtue  of  leaving  essentially  to  each  vehicle 
the  task  of  dealing  with  external  disturbances  acting  upon  it,  directly  at  the  PF  level. 

The  mathematical  setup  adopted  in  the  paper  is  well  rooted  in  Lyapunov  stability 
and  graph  theory.  At  the  pure  PF  level,  two  types  of  control  laws,  henceforth  referred 
to  as  Type  I  and  Type  II,  are  developed.  The  difference  between  them  lies  in  the 
types  of  dynamics  chosen  for  the  virtual  targets  along  the  paths. 

Key  concepts  from  input-to-state  stability  theory  [59]  are  also  used  to  derive 
results  on  the  stability,  performance,  and  robustness  of  the  overall  system  that  results 
from  putting  together  the  PF  and  vehicle  coordination  subsystems.  Here,  we  use  the 
fact  that  combination  of  the  above  systems  takes  either  a  feedback  interconnection  or  a 
cascade  form,  depending  on  whether  the  underlying  PF  laws  are  of  Type  I  or  Type  II. 
The  results  are  quite  general  in  that  they  apply  to  a  large  class  of  PF  control  systems 
satisfying  a  certain  input-to-state  stable  (ISS)  property.  For  the  sake  of  clarity  and 
completeness,  the  paper  derives  a  PF  strategy  for  a  class  of  underactuated  AUVs  that 
meets  the  required  ISS  property. 

The  key  contribution  of  the  paper  is  the  study  of  the  combined  behavior  of  the 
PF  and  coordination  systems  in  the  presence  of  temporary  communication  losses 
and  transmission  delays.  To  deal  with  communication  losses,  the  paper  proposes 
two  frameworks  for  studying  the  effect  of  communication  failures  and  delays  on  the 
performance  of  the  overall  vehicle  formation.  The  first  framework,  brief  connectivity 
losses  (BCLs),  refers  to  the  situation  where  the  communication  graph  changes  in  time, 
alternating  between  connected  and  disconnected  graphs.  Here,  we  borrow  from  and 
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expand  previous  results  on  systems  with  brief  instabilities,  namely,  by  deriving  a  new 
small-gain  theorem  that  applies  to  the  feedback  interconnection  of  these  systems.  See 
[25]  and  the  references  therein  for  an  introduction  to  systems  with  brief  instabilities 
and  their  application  to  control  systems  analysis  and  design.  The  second  framework, 
uniformly  connected  in  mean  (UCM),  applies  to  the  case  where  the  communication 
graph  may  even  fail  to  be  connected  at  any  instant  of  time;  however,  we  assume  there 
is  a  finite  time  T  >  0  such  that  over  any  interval  of  length  T  the  union  of  the  different 
graphs  is  connected.  This  framework  is  motivated  by  the  work  in  [37],  [38],  [40].  To  the 
best  of  our  knowledge,  this  is  the  first  time  that  the  impact  of  intermittent  failures  on 
coordinated  PF  is  analyzed  from  a  quantitative  point  of  view  and  estimates  on  the  rate 
of  decay  of  all  closed-loop  error  signals  are  obtained.  The  impact  of  communication 
delays  on  the  overall  system  performance  is  also  analyzed  for  the  case  of  homogeneous 
delays  and  PF  systems  of  Type  II.  Conditions  are  derived  under  which  the  PF  errors 
become  arbitrarily  small  and  the  cooperation  errors  approach  zero  exponentially.  For 
related  results  on  the  consensus  problems  for  systems  with  nonhomogeneous  delays, 
see  [20]. 

The  paper  is  organized  as  follows.  Section  2  formulates  the  PF  and  vehicle  co¬ 
ordination  problems  and  describes  general  stability-related  properties  that  are  met 
by  the  PF  closed-loop  subsystem  of  each  vehicle.  Section  3  introduces  some  basic 
notation,  summarizes  important  results  on  graph  theory,  and  develops  the  tools  that 
will  be  used  to  study  the  different  types  of  communication  topologies  considered  in 
the  paper.  Section  4  derives  a  useful  small-gain  theorem  for  the  feedback  intercon¬ 
nection  of  systems  with  brief  instabilities.  Section  5  studies  the  CPF  problem  in  the 
case  where  the  communications  network  is  subjected  to  communication  losses  with  no 
time  delays.  Section  6  extends  some  of  the  results  of  section  5  to  deal  with  switching 
communication  networks  and  time  delays.  An  illustrative  example  is  presented  in  sec¬ 
tion  7,  where  a  CPF  control  algorithm  for  a  general  class  of  underactuated  AUVs  is 
derived.  The  results  of  simulations  are  also  described.  Finally,  section  8  contains  the 
main  conclusions  and  describes  problems  that  warrant  further  research.  The  proofs 
of  several  statements  are  included  in  the  appendix. 

2.  Problem  statement.  This  section  provides  a  rigorous  formulation  of  the  PF 
and  coordination  problems  that  are  the  main  subjects  of  the  paper.  Consider  a  group 
of  n  vehicles  numbered  1 We  let  the  dynamics  of  vehicle  i  be  modeled  by  a 
general  system  of  the  form 

'A’C  ;  /  \ 

Vi  =  hi{Xi,Vi), 

where  Xi  €  R”  is  the  state,  tq  €  Rm  is  the  control  signal,  and  yi  €  R9  is  the  output 
that  we  require  to  reach  and  follow  a  path  ydiili )  :  R  — ►  R9  parameterized  by  -ji  G  R. 
Signals  to*  and  u,  denote  the  disturbance  inputs  and  measurement  noises,  respectively. 
Later  in  section  7,  an  example  will  be  given  where  the  dynamics  of  (2.1)  are  those  of 
a  very  general  class  of  AUVs.  In  that  case,  the  output  yt  corresponds  to  the  position 
of  the  vehicle  with  respect  to  an  inertial  coordinate  frame. 

For  any  continuous,  differentiable  timing  law  7i(f),  define  the  PF  and  speed  track¬ 
ing  error  variables 

(2-2)  ei(t)  :=  y^t)  -  ydi{li{t)) 

and 

(2.3)  r]i(t)  :=  ii(t)  -  vri(t), 
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respectively,  where  vri  (t)  £  R.  denotes  a  desired  temporal  speed  profile  to  be  defined. 

Inspired  by  the  work  in  [3,  22,  57],  we  start  by  defining  the  problem  of  PF  for 
each  vehicle.  In  what  follows,  ||.||  denotes  both  the  Euclidean  norm  of  a  vector  and 
the  spectral  norm  of  a  matrix. 

Definition  2.1  (PF  problem).  Consider  a  vehicle  with  dynamics  (2.1),  together 
with  a  spatial  path  ydi(pti);  7i  €  R,  to  be  followed  and  a  desired,  predetermined  temporal 
speed  profile  vri  (t)  to  be  tracked.  Let  the  PF  error  and  the  speed  tracking  error  be  as 
in  (2.2)  and  (2.3),  respectively.  Given  e  >  0,  design  a  feedback  control  law  for  Ui 
such  that  all  closed-loop  signals  are  bounded  and  both  || e* ||  and  \r/i\  converge  to  a 
neighborhood  of  the  origin  of  radius  e. 

Stated  in  simple  terms,  the  problem  above  amounts  to  requiring  that  the  output 
yi  of  a  vehicle  converge  to  and  remain  inside  a  tube  centered  around  the  desired  path 
ydi ,  while  ensuring  that  its  rate  of  progression  7 j  also  converge  to  and  remain  inside 
a  tube  centered  around  the  desired  speed  profile  vTi  (t). 

We  assume  that  the  PF  controllers  adopted  meet  a  number  of  technical  conditions 
described  next.  In  section  7,  as  an  example,  we  introduce  a  PF  controller  for  a  general 
underactuated  vehicle  that  meets  these  conditions.  The  interested  reader  will  find 
in  [22],  [57],  and  the  references  therein  related  material  on  PF  control  of  nonlinear 
systems.  See  also  [3]  for  an  interesting  discussion  on  the  possible  advantages  of  PF 
versus  trajectory  tracking  control.  Namely,  the  fact  that  PF  control  for  nonminimum 
phase  systems  removes  the  performance  limitations  that  are  inherent  to  trajectory 
tracking  schemes. 

In  preparation  for  the  development  that  follows,  we  set  vri(t)  =  VrACiit),  t)  + 
vTi(t),  where  17(7*,  t)  is  a  nominal  predetermined  speed  profile  and  vri  can  be  seen 
as  a  perturbation  component  of  vTi  about  Vl-  Later,  it  will  be  shown  that  Vl(-,  .)  is 
common  to  all  the  vehicles  and  known  in  advance  and  that 

(2.4)  vri  (■ t )  :  =  vri  (■ t )  -  vL  (7 i  (■ t ) ,  t) 

(the  remaining  component  of  vri(t))  is  not  known  beforehand.  We  assume  that  ydi(-) 
is  sufficiently  smooth  with  respect  to  its  argument.  We  further  assume  that  Vl{-,  •)  is 
bounded  and  globally  Lipschitz  with  respect  to  the  first  argument,  that  is,  3  %,  l  >  0, 
such  that  |ul(7»)*)I  <  and  |ul(7»>*)  -  Ul(7j>*)I  <  l\li  ~  lj\- 

Consider  vehicle  i  and  assume  a  feedback  control  law  17  =  77(27, 2/07,17)  exists 
that  solves  the  PF  problem  of  Definition  2.1.  Let  the  corresponding  closed- loop  PF 
system  be  described  by 

(2-5)  Ci  =  fci{t,Ci,vrt,di), 

where  d;  subsumes  all  the  exogenous  inputs  (including  disturbances  and  measurement 
noises),  vri  is  defined  as  in  (2.4),  and  state  vector  Q  includes  necessarily  e*  but  may 
or  may  not  include  77.  Two  types  of  PF  strategies  will  be  considered: 

1.  Type  I.  In  this  strategy,  variable  77  plays  the  role  of  an  auxiliary  state  for 
the  PF  algorithm  and  specifies  the  evolution  of  7 7  In  this  case  ry  is  a  state 
of  the  closed-loop  PF  system,  that  is,  Q  includes  ry. 

2.  Type  II.  This  strategy  is  equivalent  to  making  ry  =  0.  The  dynamics  of  77 
are  simply  77  =  vTi.  Clearly,  in  this  case  £,  does  not  include  ry . 

We  now  recall  the  definitions  of  input-to-state  stable  (ISS)  and  input-to-state 
practical  stable  (ISpS)  for  a  dynamical  system.  See  [59]  and  [31,  p.  217]  for  details 
on  ISS  and  ISpS  and  their  relation  to  Lyapunov  theory.  System  (2.5)  is  said  to  be 
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ISpS  if  there  exist  a  class  ICC  function  /?(., .),  class  K.  functions1  pi(.);  i  =  1,2,  and  a 
constant  p^  >  0  such  that  for  any  inputs  vri  and  di  and  any  initial  condition  Ci(fo)j 
the  solution  of  (2.5)  satisfies 


IlCiWII  <  ^(||C*(*o)IM-io)+Pi  (  sup  ||ur4(s)||  J+P2  (  sup  ||d;(s) II  )  +p3  Vt  >  to- 

\to<.S<t  J  \to<S<t  J 

System  (2.5)  is  said  to  be  ISS  if  it  satisfies  the  conditions  of  ISpS  with  p3  =  0. 
Assumption  2.2.  We  assume  there  exists  a  Lyapunov  function  Wi(t ,  Q)  for  (2.5) 
satisfying 


(2.6) 

(2.7) 


^rllCill2  <  Wi  <  «i||C<N2, 

Wi  <  —  Ai  Wi  +  pi \vri  |2  +  P2^2 , 


where  Ai,  pi,  p2,  Qlr  and  ol\  are  positive  values  and  Wi  is  computed  along  the  solutions 
of  (2.5),  that  is, 

dWi  dWi 


Wt  = 


dt 


dQ 


■fc 


With  this  assumption,  the  closed-loop  PF  system  (2.5)  is  ISS  with  input  ( di,vTi ) 
and  state  Q.  To  verify  this,  integrate  (2.7)  and  use  (2.6)  to  obtain 

OdllCiWII2  <  di||C*(io)||2e_Al(t_to)  +  sup  \vri  |2  +  ^sup|d;|2, 


and  therefore 


IlCiWII  <  «||Ci(*o)||e  °-5Al(t  *o)  +/9„sup|uri|  +pdsup|dj|, 

with  a  =  v/br7fii,  Pv  =  \fpiR WaJ,  and  pd  =  p2/(Aia1). 

Assuming  a  PF  controller  has  been  implemented  for  each  vehicle,  it  now  remains 
to  coordinate  (that  is,  synchronize)  the  entire  group  of  vehicles  so  as  to  achieve  a 
desired  formation  pattern  compatible  with  the  paths  adopted.  As  will  become  clear, 
this  will  be  achieved  by  adjusting  the  desired  speeds  of  the  vehicles  as  functions  of 
the  “along-path”  distances  among  them.  To  better  grasp  the  key  ideas  involved  in 
the  computation  of  these  distances,  consider  as  a  simple  example  the  case  of  a  fleet 
of  vehicles  that  are  required  to  move  along  parallel  straight  lines  and  keep  themselves 
aligned  along  a  direction  perpendicular  to  the  lines.  See  Figure  1  for  the  case  of  two 
vehicles. 

Let  F?;  denote  the  desired  path  to  be  followed  by  vehicle  i  and  assume  F,  is  simply 
parameterized  by  Sj,  the  path  length.  In  other  words,  7 j  =  .s, .  Because  each  vehicle 
approaches  the  path  as  close  as  required,  that  is,  because  iji(t)  becomes  arbitrarily 
close  to  to  ydii'yt),  it  follows  that  the  vehicles  are  (asymptotically)  synchronized  if 
7 ij(t)  :=  7 i(t)  —  7j(t)  — >  0  \/i,j  €  J\f  :=  {1, . . .  ,n}.  This  shows  that  in  the  case  of 
translated  straight  lines  7 ij  =  Si  —  Sj  is  a  good  measure  of  the  along-path  distances 
among  the  vehicles.  Similarly,  in  the  case  of  vehicles  that  must  be  aligned  along 
the  radii  of  nested  circumferences  as  in  Figure  2,  an  appropriate  measure  of  the 
distances  among  the  vehicles  is  angle  7 i  =  Si/Ri  where  Si  denotes  path  length  and 

1  A  function  p  is  of  class  K.  if  it  is  strictly  increasing  and  p(0)  =  0.  A  function  ft (r.  s )  belongs  to 
class  ICC  if  the  mapping  fi(r,  s)  is  of  class  K  for  a  fixed  s,  is  decreasing  with  respect  to  s  for  a  fixed 
r,  and  /3(r,  s)  — >  0  as  t  — >  oo. 
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Fig.  1.  Along-path  distances:  straight 
lines. 


Fig.  2.  Along-path  distances:  circumferences. 


Ri  is  the  radius  of  circumference  i.  Clearly,  this  corresponds  to  adopting  different 
parameterizations  for  the  paths  that  correspond  to  normalizing  their  lengths.  In 
both  cases,  we  say  that  the  vehicles  are  coordinated  if  the  corresponding  along-path 
distance  is  zero,  that  is,  7*  —  fj  =  0.  Coordination  is  achieved  by  adjusting  the  desired 
speed  of  each  vehicle  i  as  a  function  of  the  along-path  distances  7^;  j  £  TV,,  where  Nt 
denotes  the  set  of  vehicles  with  which  vehicle  i  communicates.  For  arbitrary  types  of 
paths  and  coordination  patterns,  an  adequate  choice  of  path  parameterizations  will 
allow  for  the  conclusion  that  the  vehicles  are  coordinated  or,  in  equivalent  terms,  are 
synchronized /have  reached  agreement,  iff  7 ij  =  0  Vj,  i  £  A f\  see  [22],  [16].  Since  the 
objective  of  the  coordination  is  to  coordinate  variables  7 j,  we  will  refer  to  them  as 
coordination  states. 

We  will  require  that  the  formation  as  a  whole  (group  of  multiple  vehicles)  travel 
at  an  assigned  speed  profile  VL{fi,t)  when  coordinated,  that  is,  7*  =  vl  Vi  £  A f, 
where  vp  is  allowed  to  be  a  function  of  path  parameter  7  and  time  t.  This  follows 
from  the  fact  that  vp(fyi,t)  =  vp (7-,- ,  t)  when  7*  =  7 This  issue  requires  clarification. 
Note  that  the  desired  speed  assignment  is  given  in  terms  of  the  time  derivatives  of 
the  coordination  states  7 *,  not  in  terms  of  the  inertial  speeds  (actual  time  derivative 
of  the  positions)  of  the  vehicles  undergoing  synchronization.  In  the  limit,  as  shown 
later,  the  combined  PF  and  coordination  algorithms  will  ensure  that  the  coordination 
states  will  be  equal  and  the  vehicle  speeds  will  naturally  approach  i  £  Af,  so 
that  ^  =  Vl-  Thus,  ^  =  Vl/^j:  which  shows  clearly  how  coordination 

states  speed  and  inertial  speeds  depend  on  the  path  parameterizations  adopted.  In 
the  case  of  the  circumferences  above,  the  latter  relationship  yields  simply  'Mf  =  RiVl- 
Notice  how  the  speed  assignment  in  terms  of  the  coordination  states  avoids  the  need 
to  specify  the  actual  inertial  speeds  of  the  vehicles  in  an  inertial  reference  frame,  which 
would  be  quite  cumbersome.  Instead,  all  that  is  required  is  to  specify  the  speeds  of 
the  coordination  states  which  are  equal  and  degenerate  simply  into  vp. 

From  (2.3),  the  evolution  of  the  coordination  state  7i,  i  £  Af,  is  governed  by 

(2.8)  7  i(t)  =  vri(t)  + 

where  the  speed  tracking  errors  rji  are  viewed  as  disturbance-like  input  signals  and 
the  speed  profiles  vTi  are  taken  as  control  signals  that  must  be  assigned  to  yield 
coordination  of  the  states  7*.  To  achieve  this  objective,  information  is  exchanged 
through  an  intervehicle  communication  network.  Typically,  all-to-all  communications 
are  impossible  to  achieve.  In  general,  7,;  will  be  a  function  of  7 i  and  of  the  coordi- 
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nation  states  of  the  so-called  neighboring  agents  defined  by  set  TV,.  For  simplicity 
of  presentation,  throughout  this  paper  we  assume  that  the  communication  links  are 
bidirectional,  that  is,  i  G  Nj  j  €  TV,.  Equipped  with  the  above  notation,  we  are 
now  ready  to  formulate  the  CPF  problem. 

Definition  2.3  (CPF).  Consider  a  set  of  vehicles  V,;  i  G  A f,  with  dynamics 
(2.1),  together  with  a  corresponding  set  of  paths  ydXli)  parameterized  by  7 i  and  a 
formation  speed  assignment  VLiptut).  Assume  that  for  each  vehicle  there  is  a  feed¬ 
back  control  law  Uiixi^y^vif)  such  that  the  closed-loop  systems  (2.5)  satisfy  Assump¬ 
tion  2.2.  Further  assume  that  7 i  and  7 j,  j  €  TV,,  are  available  to  vehicle  i  G  AT.  Given 
e  >  0  arbitrarily  small,  derive  a  control  law  for  vTi  such  that  the  PF  errors  ||e»||,  the 
coordination  errors  7 ,  —  7 j,  and  the  formation  speed  tracking  errors  7 ,  — 17  \/i,j  €  A f, 
converge  to  a  ball  of  radius  e  around  zero  as  t  — >  00. 

3.  Preliminaries  and  basic  results.  With  the  setup  adopted,  graph  theory 
becomes  the  tool  par  excellence  for  modeling  the  constraints  imposed  by  the  commu¬ 
nication  topology  among  the  vehicles,  as  embodied  in  the  definition  of  sets  TV,,  i  G  A/. 
We  now  recall  some  key  concepts  from  algebraic  graph  theory  [24]  and  agreement 
algorithms  and  derive  some  basic  tools  that  will  be  used  in  what  follows. 

3.1.  Graph  theory.  Let  Q(V,£)  (abbreviated  Q)  be  the  undirected  graph  in¬ 
duced  by  the  intervehicle  communication  network,  with  V  denoting  the  set  of  n  nodes 
(each  corresponding  to  a  vehicle)  and  £  the  set  of  edges  (each  representing  a  data 
link).  Nodes  i  and  j  are  said  to  be  adjacent  if  there  is  an  edge  between  them.  A  path 
of  length  r  between  node  i  and  node  j  consists  of  r  +  1  consecutive  adjacent  nodes. 
We  say  that  Q  is  connected  when  there  exists  a  path  connecting  every  two  nodes  in 
the  graph.  The  adjacency  matrix  of  a  graph,  denoted  A ,  is  a  square  matrix  with  rows 
and  columns  indexed  by  the  nodes  such  that  the  i,  j-e ntry  of  A  is  1  if  j  G  TV,  and 
zero  otherwise.  The  degree  matrix  D  of  a  graph  Q  is  a  diagonal  matrix  where  the 
i,  i-entry  equals  |JVj|,  the  cardinality  of  TV,.  The  Laplacian  of  a  graph  is  defined  as 
L  :=  D  —  A.  It  is  well  known  that  L  is  symmetric  and  LI  =  0,  where  1  :=  [l]„xi 
and  0  :=  [0]nxi-  If  G  is  connected,  then  L  has  a  simple  eigenvalue  at  zero  with  an 
associated  eigenvector  1,  and  the  remaining  eigenvalues  are  all  positive. 

We  will  be  dealing  with  situations  where  the  communication  links  are  time- varying 
in  the  sense  that  links  can  appear  and  disappear  (switch)  due  to  intermittent  failures 
and/or  communication  links  scheduling.  The  mathematical  setup  required  is  described 
next. 

A  complete  graph  is  a  graph  with  an  edge  between  each  pair  of  nodes.  A  complete 
graph  with  n  nodes  has  n  =  n(n  —  1) /2  edges.  Let  Q  be  a  complete  graph  with  edges 
numbered  1 Consider  a  communication  network  among  n  agents.  To  model 
the  underlying  switching  communication  graph,  let  p  =  \pi\nx  1,  where  each  Pi(t)  : 
[0,  00)  — >  {0, 1}  is  a  piecewise-continuous  time- varying  binary  function  which  indicates 
the  existence  of  edge  i  in  the  graph  Q  at  time  t.  Therefore,  given  a  switching  signal 
pit),  the  dynamic  communication  graph  GP{t)  is  the  Pair  (V,£p(t)),  where  Pi{t)  =  1 
if  *  G  £p(t)  and  p-ft)  =  0  otherwise.  For  example,  p(t)  =  [1,0,  ...,0]T  means  that 
at  time  t  only  link  number  1  is  active.  Denote  by  Lp  the  explicit  dependence  of  the 
graph  Laplacian  on  p  and  likewise  for  the  degree  matrix  Dp  and  the  adjacency  matrix 
Ap.  Further  let  TVi|P(t)  denote  the  set  of  the  neighbors  of  agent  i  at  time  t. 

We  discard  infinitely  fast  switchings.  Formally,  we  let  S dwell  denote  the  class 
of  piecewise  constant  switching  signals  such  that  any  consecutive  discontinuities  are 
separated  by  no  less  than  some  fixed  positive  constant  time  td,  the  dwell  time.  We 
assume  that  p(t)  G  S dwell- 


Copyright  ©  by  SIAM.  Unauthorized  reproduction  of  this  article  is  prohibited. 


242 


R.  GHABCHELOO  ET  AL. 


3.2.  Brief  connectivity  losses  (BCL).  Consider  the  situation  where  the  com¬ 
munication  network  changes  in  time  so  as  to  make  the  underlying  dynamic  commu¬ 
nication  graph  Gp(t)  alternately  connected  and  disconnected.  To  study  the  impact 
of  temporary  connectivity  losses  on  the  performance  of  the  coordination  algorithms 
developed,  we  explore  the  concept  of  “brief  instabilities”  developed  in  [25].  In  partic¬ 
ular,  this  concept  will  be  instrumental  in  capturing  the  percentage  of  time  that  the 
communication  graph  is  not  connected. 

Recall  that  the  binary  value  of  the  element  pi  in  p  declares  the  existence  of 
edge  i  in  graph  Gp.  We  can  thus  build  2n  graphs  indexed  by  the  different  possible 
occurrence  of  vector  p.  Let  P  denote  the  set  of  all  possible  vectors  p,  and  let  Pc  and  Pdc 
denote  the  partitions  of  P  that  give  rise  to  connected  graphs  and  disconnected  graphs, 
respectively.  That  is,  if  p  £  Pc,  then  Gp  is  connected,  or  otherwise  disconnected. 
Define  the  characteristic  function  of  the  switching  signal  p  as 


(3.1) 


P  £  Pc, 
P  G  Pdc 


For  a  given  time-varying  p(t)  £  Sdwell,  the  connectivity  loss  time  Tp(r,t)  over  [r,  t\  is 
defined  as 


(3.2) 


X(p(s))ds. 


Definition  3.1  (BCL).  The  communication  network  is  said  to  have  BCL  if 


(3.3)  Tp(t ,  t)  <  a(t  —  t)  +  (1  —  a)To  Vi  >  r  >  0 

for  some  To  >  0  and  0  <  a  <  1.  In  this  case,  p(t)  £  Vbcl{o-,  To)  C  Sdweii,  where 
Pbcl(cx,  To)  is  identified  with  the  set  of  time-varying  graphs  for  which  the  connectivity 
loss  time  Tp(r,t)  satisfies  (3.3). 

In  (3.3),  a  provides  an  asymptotic  upper  bound  on  the  ratio  Tp(r,  t)/{t  —  r)  as 
t  —  t  — y  oo  and  is  therefore  called  the  asymptotic  connectivity  loss  rate.  When  p  €  Pdc 
over  an  interval  [r,  i],  we  have  Tp(r ,  i)  =  t  —  t,  and  the  above  inequality  requires  that 
t  —  t  <  Tq.  This  justifies  calling  To  the  connectivity  loss  upper  bound.  Notice  that 
a  =  1  means  that  the  communications  graph  is  never  connected. 

We  now  introduce  a  special  coordination  error  vector  and  some  preliminary  results 
that  will  play  an  important  role  in  the  sections  that  follow.  As  will  be  shown  later, 
the  error  state  thus  introduced  will  be  zero  iff  the  coordination  states  are  equal.  To 
this  effect,  start  by  stacking  the  coordination  states  in  a  vector  7  :=  [7i]„xi-  Given  a 
diagonal  matrix  K  >  0,  define  j3  :=  K~x  1  and  the  error  vector 


(3.4) 


7  ==  £/37, 


where 

(3-5)  £/3  :=J__L  1/3- 

and  /  is  an  identity  matrix.  The  following  lemma  holds  true. 

Lemma  3.2.  The  error  vector  7,  the  matrix  Cp,  and  the  graph  Laplacian  Lp 
satisfy  the  following  properties: 

1.  Cp  has  n  —  1  eigenvalues  at  1  and  a  single  eigenvalue  at  0  with  right  and  left 
eigenvectors  1  and  /3,  respectively,  such  that  Cpl  =  0  and  PTCp  =  0T . 

2.  CpKLp  =  KLp  \/p  £  Pc  U  Pdc 
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3.  vClK-'Cpv  <  vK~1u  Vi/eR". 

4.  7  =  0  <£>  7  £  spanjl}. 

5.  /3t7  =  0. 

6.  LP7  =  LP7  Vp  £  Pc  U  Pdc. 

7.  If  ||7||  <  e,  i/ien  I7*  —  7^ |  <  \[2e  and  ||/iLp7||  <  ne||A'||. 

8.  Let 


A2 


,m  • 


min 

pePc 

lTv-0 


vTLpv 


\m  :=  min  — - — 

pePc  v 1  v 
(3Tv=0 
vTv^0 


t  .  vTLpu 

Am  :=  mm  - 

PePcuPdc  vTv 

Lpis^O 

uTu^0 


Then„  A m  —  np1  [3  A2,m  7  0  and  Am  7s  0. 

9.  If  z  =  Lp(t) 7,  </ien  </ie  ith  component  of  z  is  Zi  =  XZj^N-  7 i  —  77 

10.  ||£(9VL(7,t)||  <  v/nmin(2nM,  v/2^||7||)>  where  vL(7,£)  =  [17(7*,  £)]„xi ■ 

Proof.  See  the  appendix.  □ 

Property  4  allows  for  the  conclusion  that  if  7  tends  to  zero,  then  \^i  —  ~/j  — >  0 
Vi,  j  G  A f,  as  t  — ■>  00  and  coordination  is  achieved.  Property  7  gives  a  bound  on  the 
coordination  errors  7 j  —  7^  given  a  bound  on  the  error  vector  7.  In  the  literature,  the 
connectivity  of  a  graph  with  Laplacian  L  is  defined  as  the  second  smallest  eigenvalue 
A2  of  L.  The  term  A2,m  defined  in  property  8  is  an  extension  of  the  concept  of 
connectivity  in  a  collective  sense,  defined  as  the  smallest  graph  connectivity  over  all 
connected  graphs  Qp.  Given  Am,  the  lower  bound  estimate  7TLP7  >  \mfT”1,  when 
p  £  Pc,  applies.  An  identical  interpretation  applies  to  Xm.  Notice  from  property  9 
that  if  the  control  signal  of  vehicle  i  is  computed  as  a  function  of  Zi,  then  the  proposed 
control  law  meets  the  communication  constraints  embodied  in  the  sets  N%. 


3.3.  Uniformly  connected  in  mean  topology.  In  the  previous  situation,  we 
considered  the  case  where  the  communication  graph  changes  in  time,  alternating 
between  connected  and  disconnected  graphs.  We  now  address  a  more  general  case 
where  the  communication  graph  may  even  fail  to  be  connected  at  any  instant  of 
time;  however,  we  assume  there  is  a  finite  time  T  >  0  such  that  over  any  interval  of 
length  T  the  union  of  the  different  graphs  is  somehow  connected.  This  statement  is 
made  precise  in  what  follows.  We  now  present  some  key  results  for  the  time-varying 
communication  graph  that  borrow  from  [37],  [38],  [40]. 

Let  Qi,  i  =  1 , ,q,  be  q  graphs  defined  on  n  nodes  and  denote  by  Li  their 
corresponding  graph  Laplacians.  Define  the  union  graph  Q  =  Uj  Qi  as  the  graph 
whose  edges  are  obtained  from  the  union  of  the  edges  £*  of  Qi,  i  =  1, . . . ,  q.  If  Q  is 
connected,  L  =  JA  Li  has  a  single  eigenvalue  at  0  with  eigenvector  1.  Notice  that  L 
is  not  necessarily  the  Laplacian  of  Q,  because  for  an  edge  e,  if  e  G  Si  and  e  £  Sj  for 
i  ^  j,  then  e  is  counted  twice  in  L  through  Li  +  Lj,  while  we  consider  only  one  link  in 
Q  as  representative  of  e.  However,  L  has  the  same  rank  properties  as  the  Laplacian  of 
Q .  Since  p  £  S dwell  (only  a  finite  number  of  switchings  are  allowed  over  any  bounded 
time  interval),  the  union  graph  is  defined  over  time  intervals  in  the  obvious  manner. 
Formally,  given  two  real  numbers  0  <  t\  <  t2,  the  union  graph  Q([t-i .  t-2))  is  the 
graph  whose  edges  are  obtained  from  the  union  of  the  edges  Sp (t)  of  graph  Qp(t)  f°r 
t  £  [ti, £2)- 

Definition  3.3  (uniformly  connected  in  mean  (UCM)).  A  switching  communi¬ 
cation  graph  Qp(t)  is  UCM  if  there  exists  T  >  0  such  that  for  every  t  >  0  the  union 
graph  Q([t,t  +  T))  is  connected. 
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For  a  given  t  >  0,  let  sq  =  t  and  the  sequence  s*,  *  =  1, . . . ,  q,  be  the  time  instants 
at  which  switching  happens  over  the  interval  [t,  t+T).  If  the  switching  communication 
graph  is  UCM,  then  the  union  graph  uf_0  Gi  is  connected  and  o  Lp(Si)  has  a  single 
eigenvalue  at  origin  with  eigenvector  1. 

Consider  the  linear  time- varying  system 

(3.6)  7  =  ~KLp  7, 

where  K  is  a  positive  definite  diagonal  matrix  and  Lp  is  the  Laplacian  matrix  of  a 
dynamic  graph  Qp.  The  following  theorem  holds;  see,  for  example,  [38]. 

Theorem  3.4  (agreement).  Coordination  (agreement)  among  the  variables  7 * 
with  dynamics  (3.6)  is  achieved  uniformly  exponentially  if  the  switching  communica¬ 
tion  graph  Gp(t)  is  UCM.  That  is,  under  this  connectivity  condition,  all  the  coordina¬ 
tion  errors  jij  (t)  converge  to  zero  and  7*  — >  0  as  t  — >  00 . 

We  now  consider  the  delayed  version  of  (3.6).  Let  the  coordination  states  7 evolve 
according  to 

(3.7)  7(f)  =  -RDp^ift)  +  AC4p(t)7(f  -  r), 

where  -Dp(t)  and  Ap^  are  the  degree  matrix  and  the  adjacency  matrix  of  Gp{t),  re¬ 
spectively.  The  following  theorem  can  be  derived  from  the  results  in  [40] . 

Theorem  3.5  (agreement-delayed  information).  The  variables  7 $  with  dynamics 

(3.7)  agree  uniformly  exponentially  for  t  >  0  if  the  switching  communication  graph 
Gp(t)  is  UCM,  that  is,  under  this  connectivity  condition,  all  the  coordination  states 
Ji(t)  converge  to  the  same  value  and  7*  — >  0  as  t  — »  00. 

A  version  of  Definition  3.3  for  directed  graphs  was  first  introduced  in  [38],  where 
the  term  “uniformly  quasi-strongly  connected”  was  used.  Here,  we  adapt  this  defini¬ 
tion  to  undirected  graphs,  thus  the  term  “uniformly  connected  in  mean”  seems  to  be 
more  adequate.  It  is  interesting  to  point  out  that  Theorem  3.4  follows  naturally  from 
the  work  in  [38]  or  from  Theorem  3.4  in  [37],  which  recovers  some  of  the  results  in  [38] 
for  linear  systems.  Theorem  3.4  can  also  be  derived  from  Theorem  1  in  [40]  by  using 
the  fact  that  p{t)  £  Sdweii  with  a  dwell  time  td  >  0.  Finally,  Theorem  3.5  can  be 
derived  from  Theorem  2  in  [40]  by  noticing  that  —KLp  is  a  matrix  with  nonnegative 
off-diagonal  elements  (Metzler  matrix)  with  all  its  row-sums  equal  to  zero. 

4.  System  interconnections.  Systems  with  brief  instabilities.  This  sec¬ 
tion  introduces  a  lemma  that  will  be  instrumental  in  deriving  the  performance  mea¬ 
sure  (error  decay  rate)  associated  with  the  coordination  algorithm  that  will  be  later 
derived  for  multivehicle  systems  communicating  over  networks  with  BCLs  (Defini¬ 
tion  3.1).  Here,  we  avail  ourselves  of  some  important  results  on  brief  instabilities  [25]. 
We  start  with  basic  definitions.  A  switching  linear  system  S  :  x  =  Apx  +  Bpu  is  a 
dynamical  system,  where  Ap  and  Bp  are  functions  of  some  time-varying  vector  func¬ 
tion  pit).  The  characteristic  function  of  S,  denoted  y,  is  defined  as  x(p)  =  0  if  S'  is 
stable  and  as  x{p)  =  1  otherwise.  Let  the  instability  time  Tp(t,  t)  of  S  be  defined  in 
a  manner  similar  to  (3.2).  Then,  S  is  said  to  have  brief  instabilities  with  instability 
bound  To  and  asymptotic  instability  rate  a  if  Tp  satisfies  (3.3). 

Lemma  4.1  (system  interconnection  and  brief  instabilities).  Consider  the  coupled 
system  consisting  of  two  subsystems 

Zl  = 

Z2  =  4>2(t,Z1,Z2,U2), 
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denoted  System  1  and  System  2,  respectively,  where  z\  and  z2  denote  the  state  vec¬ 
tors  and  Mi  and  U2  the  inputs.  Assume  there  exist  Lyapunov  functions  V\{t,  zf)  and 
V2(t,z2)  satisfying 

a1||^||2<y1<a1||^1||2, 
ay^ll2  <  v2  <  a2\\z2\\2 


and 


(4.2) 

where  ait  dj,  pi,  i  = 
bilities  characterized 


-q^-  +  —  ~ /^1^1  AlII^H2  +  uii 

-~r  +  <  —X2(t)V2  +  /?2 1| || 2  +  u\, 

Ot  OZ2 

1,  2,  and  Ai  are  positive  values.  Let  system  2  have  brief  insta- 
by 


(4.3) 


x(p(t))  = 


0,  X2(p{t))  —  a2_, 

1,  X2(p(t))  =  — a2, 


where  A2  >  0,  A2  >  0,  with  asymptotic  instability  rate  a  and  instability  bound  Tq. 
Define 


(4.4) 


Ao  +  ^2) 


■(Ai  +  A2)2  —  AiA2  + 


P1P2 

Q:  ^  ( )■  o 


that  satisfies 


min(A1,  A2) 


Qi  2  Qto 


Assume  that  a  <  Ao/(A2  +  A2)  and 

(4.5)  P1P2  <  a1a2A1A2. 


Then, 

1.  the  interconnected  system  is  ISS  with  respect  to  state  z  =  col(zi,  z2)  and  input 
u  =  co1(mi,  m2). 

2.  there  is  a  Lyapunov  function  V(t,z)  such  that 

a|N|2<^<«N|2, 

v (t)  <  cV ( to)e~Mt-to)  +  g  sup[t0)t]  u2, 

where  c  =  e(A2+A2^1_a)T°,  g  =  ^max(l,a1(Ai  —  X<f)/p2),  and  the  rate  of 
convergence  A  is  given  by  A  =  Ao  —  a(A2  +  A2). 

In  particular,  if  p2  =  0  and  p\  >  0,  then  the  interconnected  system  takes  a  cascade 
form  and  is  ISS  with  input  u  and  state  z.  Furthermore,  the  system  exhibits  convergence 
rate  A  =  min(Ai,  (1  —  a)A2  —  aA2).  The  conclusions  are  also  valid  with  a  =  0  for  the 
case  where  system  2  has  no  instabilities,  that  is,  A 2(t)  =  A2. 

Proof.  An  indication  of  the  proof  for  the  case  where  p±  and  p2  are  nonzero  is 
given  next.  See  the  appendix  for  the  proof  in  the  general  case. 
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Define  V  =  V\  +  aV 2  for  some  a  >  0  to  be  chosen  later.  Taking  the  derivative  of 
V  yields 

V<-(\i-  —)  Vl  -a  (a  2(t)  -  V2+g\\d\\2, 

\  QLi  )  V  aa2J 

where  g  =  max(l,a).  Given  any  constant  A2  >  0,  there  exists  a  >  0  such  that 
(4.7)  a,-5«=a2- -a. 

Clot  o 

if  (4.5)  is  satisfied  (small-gain  condition).  Then  V  <  —  AgV  +  g||d||2,  where  Ao  is 
given  by  (4.4),  and  the  interconnected  system  is  ISS  with  input  d.  Furthermore,  its 
convergence  rate  is  A  =  Ao- 

Consider  now  the  situation  where  A2(f)  is  time-varying.  In  this  case,  V  <  —  AoU + 
a( A2  —  A2 (t)) V2  +  g||d||.  Because  system  2  has  brief  instabilities  with  characteristic 
function  x(p),  using  the  relationship  C1V2  =  V  —  V\  yields 

y<^(Ao-A3x(p(t)))^  +  5||d||2, 

where  A3  :=  A2  +  A2.  Integrating  the  above  differential  inequalities,  it  can  be  shown 
that 

V(t)  <  V (to)e~Xo('t~t°^+X3Tp  +  g  sup[t0)t]  \\d\\2  e-^-^+^dr. 

Using  (3.3)  concludes  the  proof.  □ 

It  is  interesting  to  notice  how  the  lemma  invokes  two  conditions:  (i)  the  small- 

gain  condition  (4.5),  which  is  sufficient  to  guarantee  that  the  results  stated  hold  true 

when  system  2  is  stable,  and  (ii)  the  extra  inequality  a  <  Ao/(A2  +  A2),  that  must 

also  be  satisfied  when  system  2  has  brief  instabilities.  In  this  respect,  the  above 

lemma  generalizes  the  results  derived  in  [27]  for  the  case  where  system  2  has  no 

brief  instabilities.  As  an  example  of  application  of  the  lemma,  assume  Ai  =  A2  = 

A2  =  7,/—,  where  0  <  k  <  1.  Then  the  small-gain  condition  is  satisfied  and  the 
K  V  —1—2 

interconnected  system  of  the  lemma  above  is  ISS  if  a  <  A-=A,  which  is  smaller  than  0.5 
for  any  admissible  k. 

Equipped  with  the  results  derived  so  far,  the  next  two  sections  offer  solutions  to 
the  CPF  problem  formulated  in  section  2. 

5.  CPF  in  the  absence  of  communication  delays.  Consider  the  coordina¬ 
tion  control  problem  introduced  in  section  2  with  a  switching  communication  topology 
parameterized  by  p  :  [0, 00)  — >  {0,1}  and  with  no  communication  delays.  Recall  that 
the  coordination  states  7 $  are  governed  by  (2.8).  Inspired  by  the  work  in  [28],  [61], 
we  propose  the  following  decentralized  feedback  law  for  the  reference  speeds  vri  as  a 
function  of  the  information  obtained  from  the  neighboring  vehicles: 

(5.1)  Vri=vL-ki  ^2  (7i(t)  ~7j(t)), 

t) 

where  Vl  ("fi ,  t)  is  the  common,  nominal  speed  assigned  to  the  fleet  of  vehicles  and 
ki  >  0.  Let  km  :=  minj  ki  and  /cm  :=  max;  fc, .  Notice  that  with  this  choice  of  control 
law,  the  term  vri  =  vri  —  Vl,  for  which  the  time  derivative  is  not  available,  is  given  by 

(5.2)  vri  =  —ki  (7i(*)  ~7j(t))- 
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Using  (2.8),  (5.1),  and  property  9  of  Lemma  3.2,  the  coordination  control  closed- 
loop  system  can  be  written  in  vector  form  as 

(5-3)  7=  -ALLp(t)7  + vL(7,f) +5^77, 

where  K  =  diag[fc.;].  The  auxiliary  term  g v  was  added  for  simplicity  of  exposition: 
gv  =  1  when  the  closed-loop  PF  system  is  of  Type  I  ( rj  is  considered  a  state),  and 
gv  =  0  when  the  PF  system  is  of  Type  II  ( rj  =  0);  see  Assumption  2.2.  Using 
properties  2  and  6  of  Lemma  3.2,  the  coordination  dynamics  (5.3)  take  the  form 

(5.4)  7  =  -KLpZ/  +  £(3vL(7,t)  +  gvCpr). 

Notice  from  (5.3)  that  g  can  be  viewed  as  a  coupling  term  from  the  PF  to  the  coor¬ 
dination  dynamics. 

At  this  stage,  in  preparation  for  the  following  sections,  we  state  a  lemma  on  an 
ISS  property  that  applies  to  a  collection  of  PF  systems. 

Lemma  5.1.  Consider  n  PF  subsystems,  each  satisfying  Assumption  2.2,  and  let 
C  =  [C*]nxi-  Then  there  exists  a  single  Lyapunov  function  V\  satisfying 

alien2  <^i<diiicir, 

Vi  <  — AiVi  +  Pin2fc^||7||2  +  uf, 

where  u\  :=  i  I n  addition,  the  ISS  property 

(5.6)  ||r7(i)||  <  ||C(*)II  <  e-Xl<*-t°)|K(to)||  +  sup  U7II+P2IMI 

re[to,t) 

holds  with  Ai  =  JAAi,  p\  =  .  / P1’1  _fc m_  anc[  p2  =  1  , 

1  2ai  CL  y  Aiai 

Proof.  See  the  appendix.  □ 

Close  inspection  of  the  ISS  property  (5.6)  and  the  dynamics  (5.4)  shows  that  the 
PF  and  coordination  systems  form  a  feedback  interconnected  system. 

To  deal  with  switching  communication  topologies,  two  approaches  are  introduced 
next:  “uniform  switching  topologies”  and  “brief  connectivity  losses,”  as  defined  in  sec¬ 
tion  2.  We  now  derive  conditions  under  which  the  overall  closed-loop  system  consisting 
of  the  PF  and  coordination  subsystems  is  stable.  We  also  derive  some  convergence 
properties  for  the  complete  system. 

5.1.  UCM  topology.  This  section  addresses  the  case  where  the  communication 
network  changes  but  the  underlying  communication  graph  is  UCM  (see  Definition  3.3). 
Recall  in  this  case  that  there  is  T  >  0  such  that  for  any  t  >  0,  the  union  graph 
Q(\t,t  +  T))  is  connected.  The  section  starts  with  some  preliminary  results  leading  to 
the  statement  of  Theorem  5.2,  a  proof  of  which  is  included  in  the  appendix. 

Consider  the  unforced  coordination  closed- loop  dynamics  derived  from  (5.4),  that 
is, 

(5.7)  ^  =  -KLp  7. 

First,  we  will  show  that  if  the  switching  communication  graph  is  UCM  (with  parameter 
T  >  0),  then  Vf  >  0,  3r  G  [t,  t  +  T),  such  that  Lp(T)7(r)  ^  0.  To  this  effect,  we  let 
V  =  ^7tR'-17  whose  time  derivative  along  the  solutions  of  (5.7)  is 

v  =  -7TLPr 
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Notice  that  V  is  negative  semidefinite  whether  the  graph  is  connected  or  not.  Thus, 
7  remains  bounded.  Consider  now  the  sequence  s,,  i  =  1, . . . ,  q,  of  switching  times  in 
the  interval  [t,  t  +  T),  with  t<s\<sq<t  +  T  and  Sj  <  Sj+i  —  td,  i  =  1, . . . ,  q  —  1, 
where  tjj  is  the  dwell  time.  Let  So  =  min(f,  Si  —  td)  and  T±  =  max(sg+TD,  t+T)  —  So- 
With  this  construction  T  <  T\  <  T  +  2 td,  s\  —  td  >  So,  and  sq  +  td  <  sq  +  T\.  We 
now  show  that2  3r  €  T  :=  [s0,  So  +  Ti)  such  that  Lp(T)7(r)  ^  0. 

Assume  by  contradiction  that  Lpx  =  0  Vr  6  T  and  discard  the  trivial  solution 
7  =  0.  Then,  from  (5.7)  it  follows  that  7  =  0;  that  is,  7  remains  unchanged  over  T. 
Therefore, 

»= 0 


As  shown  in  section  3,  since  the  graph  is  UCM  the  matrix  X^i=o  ^p(st)  ^as  raRk  ti—1 
and  its  kernel  is  span{l}.  As  a  consequence,  7(so)  €  span{l},  which  contradicts  the 
fact  that  (3T 7  =  0. 

Without  loss  of  generality,  assume  Tp(So)7(so)  7^  0  and  define  Tjj  :=  [so,  so  +  Td)- 
Clearly,  Vt  e  Tj)  the  inequality  Tp(t) 7(t)  yf  0  applies  because  (5.7)  is  a  linear  time 
invariant  system  during  the  interval  considered  and  its  solutions  cannot  tend  to  zero 
in  finite  time.  It  follows  that 


(5.8) 


V(t)< 


— 2kmXmV(i),  t£  T75, 

0,  ieT\TD, 


with  Xm  as  defined  in  property  8  of  Lemma  3.2.  We  can  now  conclude  that  system  (5.7) 
with  UCM  switching  communication  graphs  has  brief  instabilities  with  asymptotic 
instability  rate  a  =  1  —  td/T\  <  1  —  td/(T  +  2 td)  and  instability  upper  bound 
Tq  =  T\  —  td  <  T  +  td  ■  That  is,  if  a  characteristic  function  \  is  defined  as 


x(t) 


0,  i<=  Td, 

1,  f£T\TD, 


then  V(t)  <  —2kmXm(l  —  Integrating  this  differential  inequality  yields 

V(t)  <  cU(T)e_2A“^_ri  Vt  >  r  >  0, 


with 

(5.9)  Aa  =  (1  -  a)kmXm,  c  =  e2Xaf° 


and  where  we  used  the  fact  that 

f  X(s)ds  <  a(t  -  t)  +  (1 


a)Tg  Vt  >  t  >  0. 


Therefore,  ||7(t)||  <  Cie  A“0  r)||7(r)ll  and 

(5.10)  \\*p(t,r)\\  <Cle-x^-T\ 

where  4>p(f,  r)  denotes  the  state  transition  matrix  of  (5.7)  and  C\  =  yj  Notice 
that  the  above  inequality  is  valid  for  all  p(t)  G  S dwell  such  that  the  graph  Qp  is  UCM. 


2Notice  that  if  3r  G  T  such  that  Lp(T)7(r)  7^  0,  then  3r±  G  [£,  t  +  T)  such  that  Lp^Tl^'y(ri)  7^  0 
because  t  <  sq  +  TD  and  t-\-T>SQ-\-T  —  T£> . 
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For  a  given  switching  signal  p(t),  input  p(t),  and  initial  state  7(^0),  the  solution  of 
(5.4)  is  given  by  (see  [53,  p.  87]) 


7(*)  =  ®P(t,to)j(t0)+  f  ^p(t,T)CpvL('y(r))T)dT+gri  f  <^p{t,T)CpT){T)dT  Vt>t0. 

Jto  J  to 

Letting 


(5.11) 


A^j  —  A^  cr  2 Til  — 


-  ex“T°l 


and  using  (5.10)  and  property  10  of  Lemma  3.2,  an  upper  bound  for  7 (t)  can  be 
derived  as 

(5.12) 

IliWII  <  cie_A“(t_*o)||7(t0)||  +  alV2n  f  e_A“(t_T)||7(r)||dr  +  sup  ||7?(r)|| 

JtQ  ^Oi  T£[to,t) 

if  Aq,  >0,  and 

(5.13)  ||7ft) II  <  cie~A°(t~to)[|7(t0)||  +  2vM^Vn  +  gup  n^n 

otherwise.  It  is  now  straightforward  to  multiply  both  sides  of  (5.12)  by  eXat  and  to 
use  the  Gronwall-Bellman  theorem  [31,  p.  66]  to  arrive  at 

(5.14)  IliWII  <  Cie"A“(t_to)||7(to)|| +5J7Y-sup||77(r)|| 


provided  that  Aa  >  0.  Notice  from  (5.11)  that  Aa  cannot  be  made  arbitrarily  large. 
It  can  be  shown  that  there  are  control  gains  ( km  =  Um)  that  make  Aq,  >  0  if  the 
Lipschitz  constant  /  of  vl  satisfies 


(5.15) 


(T  +  rD)\/2ne 


For  each  such  Z,  the  corresponding  maximum  value  of  Aa  can  be  easily  computed. 

Equipped  with  these  introductory  results,  we  now  state  the  main  theorem  of  this 
section. 

Theorem  5.2  (CPF  with  UCM).  Consider  the  interconnected  system  E  depicted 
in  Figure  3,  consisting  of  n  PF  subsystems  satisfying  Assumption  2.2  together  with 
the  coordination  control  (CC)  subsystem  (5.3)  supported  by  a  communication  network 


Fig.  3.  E;  Overall  closed-loop  system  consisting  of  the  PF  and  CC  subsystems. 
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that  is  UCM  with  parameter  T  and  switching  dwell  time  td ■  Then,  S  is  input-to- 
state  practical  stable  (ISpS)  with  respect  to  the  states  7  and  f,  the  input  u\,  and  the 
constant  2vMCi\/n/ Xa  if 


(5.16) 


61 V  Aiai 
always, 


<  Ao, 


PF  of  Type  I, 
PF  of  Type  II, 


where  Ao  =  Aa  as  defined  in  (5.9).  If  (5.15)  holds,  the  control  gains  can  be  chosen 
such  that  Xa  >  0.  In  this  case,  S  is  ISS  with  respect  to  the  states  7  and  (  and  input  u\ 
under  condition  (5.16)  with  Ao  =  Aa  as  defined  in  (5.11).  Furthermore,  the  PF  error 
vectors  e*,  the  speed  tracking  errors  \  7,  —  17 1,  and  the  coordination  errors  I7*  —  7j| 
Vi,  j  €  A f  converge  exponentially  fast  to  some  ball  around  zero  as  t  — >  00,  with  rate  at 
least  min(Ao,Ai). 

Proof.  A  proof  of  (5.15)  is  given  in  the  appendix.  Using  the  ISS  version  of  the 
small-gain  theorem  for  the  interconnection  of  (5.14)  and  (5.6)  in  the  case  of  Aa  >  0, 
and  for  the  interconnection  of  (5.13)  and  (5.6)  otherwise,  leads  to  the  result.  0 

From  the  above,  under  the  UCM  assumption,  it  follows  that  the  complete  CPF 
control  system  is  ISS  if  condition  (5.15)  is  satisfied.  In  the  absence  of  disturbances 
and  noise,  the  origin  of  the  system  becomes  globally  asymptotically  stable  (in  fact, 
exponentially  stable).  In  the  case  when  condition  (5.15)  is  not  satisfied,  all  that  can 
be  shown  is  that  the  complete  system  is  ISpS. 

5.2.  BCLs.  This  section  addresses  the  situation  where  the  communication  net¬ 
work  has  BCLs;  see  Definition  3.1.  In  this  case  the  underlying  communication  graph 
switches  between  connected  and  disconnected  configurations  with  known  asymptotic 
connectivity  loss  rate  a  and  connectivity  loss  upper  bound  Ta. 

The  following  result  provides  conditions  under  which  the  overall  closed-loop  sys¬ 
tem  consisting  of  the  PF  and  coordination  subsystems  is  ISS. 

Theorem  5.3  (CPF  with  BCLs).  Consider  the  interconnected  system  S  de¬ 
picted  in  Figure  3,  consisting  of  n  PF  subsystems  that  satisfy  Assumption  2.2  and 
the  coordination  subsystem  (5.3)  with  a  communication  network  subjected  to  BCLs 
characterized  by  (3.3).  Let  A2  :=  fcmAm  —  Define  kg  :=  and 


Ao  —  Aq  —  -i  /  Aq  —  A1A2  I  1  — 


Pi 


kgCXlXl  J 


where  Ao  =  ^(Ai  +  A2)  and  Xm  is  defined  in  Lemma  3.2,  property  8.  Assume 
(5.17) 


fcm  > 
k  m  Xm 


Further  assume  the  following  conditions  hold: 

(a)  [PF  of  Type  I]  The  asymptotic  connectivity  losses  rate  a  satisfies 


a  < 


Xn 


2k  m.  Xn 


and 


Pi 

S1A1 


<  ka. 
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(b)  [PF  of  Type  II]  a  <  1  -  ■ 

Then ,  S  is  ISS  with  respect  to  the  states  7  and  £  and  input  u\  (see  Figure  3).  Further¬ 
more,  the  PF  error  vectors  e,,  the  speed  tracking  errors  |7*  —  vl\,  and  the  coordination 
errors  |7j  —  7^ |  Mi,j  €  A f  converge  exponentially  fast  to  some  ball  around  zero  (de¬ 
pending  on  the  size  of  u\)  as  t  — >  00,  with  rate  at  least 


|  Ac-  2akmXm,  PF  of  Type  I, 

\  min(Ai,  A2  -  2a/cmAm),  PF  of  Type  II. 


Proof.  Choose  the  Lyapunov  candidate  function 

P2  := 


whose  time  derivative  along  the  solutions  of  (5.4)  is 


V2  =  -7t^p7  +  1TK  1^/3Vi(7,  t)  +  gvlTK  1£prj 

<  -7t^p7+  ^t^I|7||2  +  gv0i;)TK-l^+  jjhrf  CTpK~l Cpr), 

Km  4(71 

where  we  used  Young’s  inequality  and  property  10  of  Lemma  3.2.  Using  properties  3 
and  8  of  Lemma  3.2,  the  above  inequality  yields 


(5.18) 


f  ;yA2U2  +  p2||r/H2,  pG  Pc, 
1  X2V2  +  p2||??||2,  p  e  Pdc , 


with  A2  =  2fcA(.^”  +  2gv6i,  A2  =  2A mkm  -  A2,  p2  =  4^7-  In  order  for  A2  and  A2  to 
be  positive,  Q\  must  satisfy  0  <  6\  <  Xmkm  —  ■  It  is  straightforward  to  check 

that  this  condition  holds  if  rr^  >  . 

KM 

Close  inspection  of  (5.5)  and  (5.18)  shows  that  the  PF  and  coordination  subsys¬ 
tems  form  a  feedback  interconnected  system  with  77  and  7  as  interacting  signals,  as 
shown  in  Figure  3.  We  now  use  Lemma  4.1  and  the  fact  that  the  coordination  subsys¬ 
tem  has  BCLs  as  defined  in  (3.3)  to  find  conditions  under  which  the  interconnected 
system  is  ISS  from  input  U\.  We  consider  the  cases  where  the  PF  algorithms  are  of 
Type  I  or  II. 

[PF  of  Type  I]  Consider  the  feedback  interconnection  of  (5.5)  and  (5.18)  for  the 
case  where  g v  =  1,  that  is,  with  p2  >  0.  Resorting  to  Lemma  4.1  for  interconnected 
systems  with  brief  instabilities  and  applying  the  small-gain  condition  (4.5),  we  obtain 


(pin2  k2M) 


1 


4:km0l 


<  (ffil) 


2  kM 


(A,)  (2Arofcm-2^^-201 


or  equivalently, 


Pi  4 km  „ 

a1X1  n2kzM  1 


the  right-hand  side  of  which  is  maximized  for  6\  =  2p—{Xmkm  —  lV2nkM)-  Inserting 
the  latter  value  of  6\  in  the  inequality  above,  the  conditions  of  the  theorem  for  PF 
strategies  of  Type  I  follow  immediately. 
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[PF  of  Type  II]  In  this  case  the  interconnection  of  (5.5)  and  (5.18)  takes  a  cascade 
form,  that  is,  gv  =  0  and  (5.18)  simplifies  to 


(  —  X2V2,  p  £  Pc, 

\  A2V2,  p  G  Pdc, 


where  A  2  =  2iv/|"fcM  and  A2  =  2Xmkrn  —  A2.  Using  Lemma  4.1  with  p2  =  0  the 
conditions  of  the  theorem  for  PF  strategies  of  Type  I  are  easily  obtained.  □ 

At  this  point,  it  is  interesting  to  work  out  a  simple  numerical  example  to  illustrate 
some  of  the  results  derived.  To  this  effect,  consider  the  CPF  problem  for  three  vehicles 
( n  =  3).  In  this  case,  Am  =  1.  We  consider  both  the  case  where  the  speed  profile 
Vl  is  constant  and  the  case  where  17(71)  =  2  +  sin(7i),  for  which  l  =  0  and  l  =  1, 
respectively.  Choose  K  =  2V6/3  to  guarantee  condition  (5.17)  for  both  cases  of 
Vl-  Further  assume  that  the  ISS  property  of  the  PF  subsystem  is  satisfied  with 
Ai  =  VQ  and  a±  =  \/6.  It  is  now  straightforward  to  compute  the  following  parameters 
consecutively.  For  1  =  0:  X2  =  2\/6,  kg  =  4/36,  and  Ao  =  3/2\/6.  The  small-gain 
condition  (4.5)  will  require  that  pi  <  4/6.  For  1  =  1:  X2  =  \/6,  kg  =  1/36,  and 
Ao  =  VO-  The  same  small-gain  condition  will  yield  p\  <  1/6  in  this  case.  As  expected, 
pi  (which  can  be  viewed  as  a  stability  margin)  is  reduced  when  the  vl  depends  on 
the  path  parameter.  Let  pi  =  1/24  to  ensure  stability  for  both  cases  of  vl  above. 
We  can  now  compute  Ao  =  0.54V6  for  l  =  0  and  Ao  =  0.5V6  for  1  =  1.  It  follows 
from  the  above  that  when  PF  is  of  Type  I  the  interconnected  system  will  be  ISS  if 
the  asymptotic  connectivity  loss  rate  is  a  <  13.5%  for  l  =  0  and  a  <  12.5%  for  l  =  1. 
When  PF  is  of  Type  II,  the  bounds  are  relaxed  to  a  <  100%  for  l  =  0  and  a  <  50% 
for  1=1.  Better  convergence  rates  could  be  guaranteed  if  one  were  to  aim  for  ISpS 
rather  than  ISS. 


6.  CPF:  Delayed  information.  In  this  section  we  study  the  problem  of  CPF 
in  the  presence  of  communication  delays.  We  consider  the  case  where  all  communica¬ 
tion  channels  have  the  same  delay,  r  >  0.  We  further  assume  that  the  PF  closed- loop 
subsystems  are  of  Type  II,  that  is,  p  =  0. 

Motivated  by  (5.1),  we  assume  that  the  control  law  for  the  reference  speed  vri  of 
each  vehicle  is  given  by 


(6.1)  Vri=vL-ki  ^2  (7*(t)  -  jj(t  -  t)). 

jeJVi,P(  t) 


Using  (2.8)  and  (6.1),  the  closed-loop  coordination  subsystem  can  be  written  as 


(6.2)  7 (t)  =  vL(j,t)  -  KDp(t)y(t)  +  KAp(t)j(t  -  r), 

where  Dp  and  Ap  are  the  degree  matrix  and  the  adjacency  matrix  of  the  communi¬ 
cation  graph,  respectively.  We  now  determine  conditions  under  which  coordination 
is  achieved,  that  is,  under  which  there  exists  a  signal  70(f)  such  that  7  =  7o(t)l  is  a 
solution  of  (6.2).  Should  such  a  solution  exist,  then  substituting  it  in  (6.2)  and  using 
the  fact  that  Ap  =  Dp  —  Lp  yields 

7ol  =  vL( 7o,f)l  -  KDp^oft)!  +  K(DP  -  Lp)j0(t  -  r)  1, 


which  simplifies  to 


(6.3)  70 1  -  vl1  =  -(7o(f)  -  7o(f  -  t))KDp1. 
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The  equality  above  is  verified  iff  all  elements  of  the  right-hand  side  vector  are  equal. 
For  this  to  be  true,  one  of  the  following  two  conditions  must  apply: 

[Cl]  7o(t)  is  either  a  constant  or  a  periodic  signal  with  period  r.  In  this  case 
70(f)  —  70 (f  —  t)  =  0  Vt  and  (6.3)  holds  with  70  =  Vl-  This  condition  is  not 
relevant  from  a  practical  standpoint. 

[C2]  Vt,  KDp(t)  =  kl  for  some  k  >  0.  This  requires  that  the  degrees  of 
the  nodes  of  the  switching  communication  graph  Qp  never  vanish,  that  is, 
\NitP\  y^  0  Vt,  so  that  the  degree  matrix  Dp  is  always  nonsingular  and  we  can 
set  the  control  gains  to  K  =  kD 'p*.  In  this  case,  the  control  gains  become 
piecewise  constant  functions  of  p. 

In  view  of  the  above  discussion  we  consider  only  condition  C2.  To  lift  the  constraint 
\Nijj\  yt  0  and  have  the  CPF  algorithm  be  applicable  to  more  general  types  of  switch¬ 
ing  topologies,  we  will  later  modify  the  control  law  (6.1).  In  what  follows,  we  assume 
vl  is  constant.  We  start  by  studying  the  convergence  properties  of  only  the  coordi¬ 
nation  dynamics  in  Lemmas  6.1  and  6.2  below.  This  is  followed  by  the  analysis  of  the 
combined  PF  and  coordination  systems  in  Theorem  6.3. 

Lemma  6.1.  Consider  the  coordination  system  dynamics  (2.8)  with  the  control 
law  (6.1).  Assumethat  |./ViiPp)|  y^  0  Vi,  and  let  the  control  gains  be  ki(t)  =  fc/|7Vi,p(t)|- 
Then,  the  states  7 i  uniformly  exponentially  agree  if  the  underlying  communication 
graph  Qp  is  UCM.  In  this  situation,  I7*  —  7y|  — »  0  and  7*  — ►  70  as  t  — >  00,  where  70 
is  a  solution  of  the  delay  differential  equation 

(6.4)  7o  =  (70(f)  -  7o (t  -  t))  +  vL. 

Proof.  As  explained  before,  with  the  control  law  (6.1)  the  coordination  system 
takes  the  form  (6.2).  Let 

(6.5)  7(f)  =  7(f)  —  7o(t)l 
and  substitute  7  from  (6.5)  in  (6.2)  to  obtain 

(6  6)  ^0<^1  +  ^  =  -t)  + 

-K(t)Dp(t)jo(t)l  +  A'(f)Ap(t)7o(f  -  r)  1  +  vLl, 

which  simplifies  to 

(6.7)  7  =  -/17(f)  +  kD~lApZf{t  -  t) 

if  70 (t)  is  the  solution  of  (6.4)  and  K(t)  =  kDp 1.  From  Theorem  3.5,  states  7,  in 

(6.7)  agree  uniformly  exponentially.  In  particular,  7  — »  0  as  t  — >  00.  Thus,  from  (6.5) 
7  — >  70I,  and  the  results  follow.  □ 

In  general,  if  vl  is  not  constant  the  delayed  differential  equation  (6.4)  has  no 
closed  form  solution.  However,  for  the  particular  case  of  vl  constant,  one  solution  is 
7o(£)  =  v*Lt,  where  v*L  =  1'fkT .  Notice  that  due  to  the  transmission  delay  r  there  is  a 
finite  error  in  the  speed  tracking;  that  is,  7 j  converges  to  vf  and  not  to  17. 

Consider  now  the  case  where  there  are  instants  of  t  time  at  which  \NiiP(t^  j  =  0 
for  some  i  €  A f.  Notice  that  with  the  setup  adopted  in  this  paper,  this  condition 
will  necessarily  hold  over  a  countable  number  of  disjoint  intervals  of  time,  where  the 
length  of  each  interval  is  bounded  above  and  below  by  To  and  775,  respectively. 

In  this  case,  (6.2)  can  be  rewritten  in  terms  of  7  defined  in  (6.5)  as 

(6.8)  7  =  -K(t)Dp(t)i(t)  +  K(t)Ap(t);y(t  -  r)  +  v*Lr(kI  -  K{t)Dp)  1. 
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Clearly,  when  r  =  0  agreement  is  achieved  for  any  choice  of  positive  definite  K  due 
to  Theorem  3.5.  However,  this  is  not  necessarily  the  case  when  r  /  0.  To  see  this, 
assume,  for  example,  that  the  agreement  dynamics  (6.8)  are  at  rest,  that  is,  7,  =  0 
Vi  £  A f.  Then,  if  \Ni  pu\  \  =  0  for  some  i  and  t  in  a  given  interval  of  time,  the  dynamics 
of  the  ith  row  of  (6.8)  become  7,;  =  v^  —  v*l .  This  problem  can  be  resolved  by  applying 
different  desired  speeds  when  vehicle  i  has  no  neighbors.  The  solution  is  stated  next. 

Lemma  6.2.  Consider  the  coordination  system  dynamics  with  control  law 

(6.9)  Vr .  =  /  Vl  +  Wmd  ^jeNi,p  7i(t)  ~  7j(t~  t),  NitP  ±  0, 

where  k  >  0.  Then,  the  states  7 *  uniformly  exponentially  agree  if  the  underlying 
communication  graph  Qp  is  UCM.  In  this  case,  I7*  —  7^  |  — >  0  and  7,  — >  v*L  as  t  — >  00. 

Proof.  The  closed-loop  coordination  dynamics  can  be  expressed  in  vector  form  as 

7  =  —KDp'yit)  +  KApj(t  -  r)  +  —  —  l*L  KDP1  +  v*Ll. 

Letting  7 (t)  =  v}tl  +  -y(t)  simplifies  the  closed- loop  dynamics  to 

7  =  ~KDp^{t)  +  KAp'jft  -  r). 

Theorem  3.5  implies  that  7  and  7  will  converge  to  the  span{l}  and  to  0,  respectively, 
as  t  — >  00.  This  concludes  the  proof.  □ 

Notice  that  in  order  to  implement  the  control  law  (6.9)  the  vehicles  need  to  know 
the  delay  r  in  order  to  compute  v*L.  This  raises  the  practical  issue  of  how  to  estimate 
r.  This  issue  is  not  addressed  in  this  paper.  The  following  theorem  concludes  this 
section. 

Theorem  6.3  (CPF  with  delay).  Consider  system  S  that  is  obtained  by  putting 
together  the  n  PF  subsystems  satisfying  Assumption  2.2  and  the  coordination  subsys¬ 
tems  studied  in  Lemma  6.1  or  6.2.  Then,  the  complete  system  S  is  ISS  with  input 
U\.  In  particular,  PF  errors  ||e»||  tend  to  some  ball  around  zero,  and  the  coordination 
errors  \ji  —  7^ |  and  the  speed  tracking  errors  I7*  —  v*L\  converge  to  zero  exponentially. 

Proof.  Using  Lemma  6.1  or  6.2,  we  conclude  that  vri  =  vri  —  Vl  =  7i  —  vl 
converges  to  Vl  —  v*L  exponentially.  Close  examination  of  (2.7)  shows  that  the  PF 
and  coordination  control  subsystems  form  an  interconnected  cascade  system  where 
vTi  is  the  output  of  the  coordination  control  (CC)  subsystem  and  the  input  to  the  PF 
subsystems.  Since  that  latter  is  ISS  from  input  vTi ,  the  results  follow.  □ 

The  exposition  in  this  section  was  strongly  motivated  by  previous  work  on  agree¬ 
ment  problems  for  systems  with  delays.  Especially  relevant  are  the  results  available 
in  [40]  and  [8],  [10]  for  continuous  time  and  discrete  time,  respectively.  In  particular, 
the  results  in  [40]  address  the  unforced  version  of  (6.2),  that  is,  with  vl(7,  £)  =  0. 
The  results  in  this  section  reformulate  those  in  [40]  to  the  case  where  the  agreement 
dynamics  are  forced  by  vl(7,  t). 

7.  Illustrative  example.  This  section  presents  an  example  that  illustrates  the 
application  of  the  CPF  techniques  developed  for  the  control  of  three  AUVs. 

7.1.  CPF  of  three  underactuated  AUVs.  Consider  the  problem  of  CPF 
control  of  three  underactuated  AUVs.  Vehicle  2  is  allowed  to  communicate  with 
vehicles  1  and  3,  but  the  latter  two  do  not  directly  communicate  between  themselves. 
To  simulate  losses  in  the  communications,  we  considered  the  situation  where  both 
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links  fail  75%  of  the  time,  with  the  failures  occurring  periodically  with  a  period  of 
10 [sec].  Moreover,  the  information  transmission  delay  is  5 [sec].  Notice  that  during 
failures  all  the  links  become  deactivated.  Since  in  this  scenario  the  valencies  of  the 
nodes  vanish  periodically,  we  apply  the  results  of  Lemma  6.2.  In  the  simulations,  we 
used  the  control  law  (6.9)  with  k  =  0.1[sec-1]. 

7.1.1.  AUV  model.  Consider  an  underactuated  vehicle  modeled  as  a  rigid  body 
subject  to  external  forces  and  torques.  (See  [19]  for  details  on  vehicle  modeling.)  Let 
{1}  be  an  inertial  coordinate  frame  and  {B}  a  body-fixed  coordinate  frame  whose 
origin  is  located  at  the  center  of  mass  of  the  vehicle.  The  configuration  (R,  p)  of  the 
vehicle  is  an  element  of  the  special  Euclidean  group  SE( 3)  :=  SO( 3)  x  R3,  where  R  G 
SO(3)  :=  {R  G  R3x3  :  RRT  =  J3,  det(i?)  =  +1}  is  a  rotation  matrix  that  describes 
the  orientation  of  the  vehicle  and  maps  body  coordinates  into  inertial  coordinates, 
and  p  G  R3  is  the  position  of  the  origin  of  {B}  in  {I}.  Denote  by  v  G  M3  and 
G  M3  the  linear  and  angular  velocities  of  the  vehicle  relative  to  {1}  expressed  in 
{B},  respectively.  The  following  kinematic  relations  apply: 


(7.1a) 

p  =  Rv, 

(7.1b) 

R  =  RS(u), 

where 

0 

-X3 

X2 

S(x)  := 

X3 

0 

~X\ 

Vx  :=  (xi,X2,X3)t  G  R3 

-*2 

X\ 

0 

We  consider  underactuated  vehicles  with  dynamic  equations  of  motion  of  the  form 

(7.2a)  Mz>  =  —  S(w)Mi/  +  fv(v,  p,  R)  +  B\U\, 

(7.2b)  Jc5  =  fu(v,u,p,R)  +  B2u2, 

where  M  G  R3x3  and  J  €  R3x3  denote  constant  symmetric  positive  definite  mass  and 
inertia  matrices,  respectively.  u\  G  R  and  U2  G  R3  denote  the  control  inputs,  which 
act  upon  the  system  through  a  constant  nonzero  vector  B\  G  R3  and  a  constant  non¬ 
singular  matrix  B2  G  R3  ,  respectively;  and  /„(•),  /„(•)  represent  all  the  remaining 
forces  and  torques  acting  on  the  body.  For  the  special  case  of  an  underwater  vehicle, 
M  and  J  also  include  the  so-called  hydrodynamic  added-mass  Ma  and  added-inertia 
Ja  matrices,  respectively,  i.e.,  M  =  Mrs  +  Ma,  J  =  Jrb  +  Ja,  where  Mrs  and  Jrb 
are  the  rigid-body  mass  and  inertia  matrices,  respectively. 

A  solution  to  the  PF  problem  (defined  in  section  2)  of  an  AUV  was  given  in  [1],  [2], 
where  the  control  laws  require  that  7 j  and  7 j  be  known.  Recall  that  we  decomposed 
the  desired  speed  profile  into  two  parts  as  vri  =  vl  +  vri  hr  which  only  the  derivatives 
of  vl  can  be  computed  accurately.  However,  it  can  be  shown  that  in  the  control  laws 
of  [1],  [2],  if  the  terms  7 \  and  7 \  are  replaced  with  vl  and  Vl,  respectively,  the  resulting 
PF  closed-loop  system  becomes  ISpS  from  vri  as  an  input.  This  leads  to  the  following 
result. 

Theorem  7.1  (PF-AUV).  Consider  an  underactuated  AUV  with  the  equations  of 
motion  given  by  (7.1)  and  (7.2)  and  a  desired  path  Pd(7)  in  3D-space  to  be  followed. 
There  is  a  control  law  for  u\  and  U2  as  functions  of  the  local  states  p d  and  Vl  that 
makes  the  closed-loop  system  satisfy  Assumption  2.2. 

Proof.  See  the  appendix.  □ 
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y  [m] 


Fig.  4.  CPF  of  three  AUVs,  with  communication  losses  and  delay. 


Remark  7.2.  It  is  important  to  notice  that  the  particular  PF  algorithm  that  we 
derive  yields  input-to-state  practical  stability,  not  input-to-state  stability.  However, 
the  key  results  obtained  in  the  paper  hold  true,  for  input-to-state  practical  stability 
can  always  be  viewed  as  an  input-to-state  stability  condition  with  an  extra  constant 
input. 

7.1.2.  Simulations.  In  the  simulations,  the  AUVs  are  required  to  follow  three 
similar  spatial  paths  shifted  along  the  depth  coordinate;  that  is,  the  paths  are  of  the 
form 


with  Ci  =  20  m,  C2  =  0.05  m,  T  =  400,  <f>d  =  —  and  Zq1  =  —10  m,  Zq2  =  —5  m,  Zq3  = 
0m.  The  initial  conditions  are  pi  =  (5 m,  — 10 m,  — 5 m),  P2  =  (5 m,  — 15 m, 0 m), 
P3  =  (5m,  —20m,  5 m),  R\  =  R2  =  R3  =  /,  and  v%  =  V2  =  V3  =  u>\  =  102  =  W3  =  0. 
The  reference  speed  vl  was  set  to  vl  =  0.5[sec-1]. 

The  vehicles  are  also  required  to  keep  a  formation  pattern  that  consists  of  having 
them  aligned  along  a  common  vertical  line.  Figure  4  shows  the  trajectories  of  the 
AUVs.  Figure  5  illustrates  the  evolution  of  the  coordination  and  PF  errors  when 
the  communication  links  fail  periodically.  Clearly,  the  vehicles  adjust  their  speeds 
to  meet  the  formation  requirements,  and  the  coordination  errors  712  :=  71  —  72  and 
713  :=  71  —  73  converge  to  zero. 

8.  Conclusions.  This  paper  addressed  the  problem  of  steering  a  group  of  vehi¬ 
cles  along  given  paths  while  holding  a  desired  intervehicle  formation  pattern  (coordi¬ 
nated  path- following) ,  all  in  the  presence  of  communication  losses  and  time  delays. 
The  solution  proposed  builds  on  Lyapunov-based  techniques  and  addresses  explicitly 
the  constraints  imposed  by  the  topology  of  the  intervehicle  communications  network. 
The  problem  of  temporary  communication  failures  was  addressed  under  two  scenar¬ 
ios:  “brief  connectivity  losses”  and  “connected  in  mean”  communication  graphs.  With 
the  framework  adopted,  path- following  and  coordinated  control  system  design  become 
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(a)  Path-following  errors  (b)  Vehicle  coordination  errors 


Fig.  5.  75%  of  temporal  communication  losses;  time  delay  5 [sec]. 


partially  decoupled.  As  a  consequence,  the  dynamics  of  each  autonomous  underwater 
vehicle  can  be  dealt  with  by  each  vehicle  controller  locally,  at  the  path-following  con¬ 
trol  level.  Coordination  can  then  be  achieved  by  resorting  to  a  decentralized  control 
law  whereby  the  exchange  of  data  among  the  vehicles  is  kept  at  a  minimum.  The 
system  obtained  by  putting  together  the  path-following  and  the  vehicle  coordination 
strategies  proposed  was  shown  to  be  either  a  feedback  interconnection  or  a  cascade 
of  two  input-to-state  stable  systems.  Stability  and  convergence  properties  of  the  re¬ 
sulting  interconnected  system  were  studied  formally  by  introducing  a  new  small-gain 
theorem  for  systems  with  brief  instabilities.  Simulations  illustrated  the  efficacy  of  the 
solution  proposed. 

Further  work  is  required  to  extend  the  methodology  proposed  to  tackle  more 
complex  coordination  control  problems,  namely,  coordinated  control  in  the  presence 
of  stringent  communication  constraints  that  arise  in  the  underwater  world  such  as 
nonhomogeneous  time  variable  delays,  tight  energy  budgets,  and  reduced  channel 
capacity.  In  particular,  the  study  of  coordinated  path- following  control  systems  yield¬ 
ing  quantifiable  measures  of  performance  in  the  case  of  unidirectional,  event  driven 
communications,  is  warranted. 

Appendix. 

Proof  of  Lemma  3.2. 

1.  Since  Rank(J  —  Cp)  =  1,  Cp  has  n  —  1  eigenvalues  at  1.  Using  the  definition 
of  Cp ,  it  can  be  easily  verified  that  Cpl  =  0  and  (3TCp  =  0T,  that  is,  zero  is 
an  eigenvalue.  Therefore,  we  can  conclude  that  zero  is  a  single  eigenvalue. 

2.  CpKLp  =  (K  -  T)Lp  =  KLp,  since  1  TLp  =  0T. 

3.  Straightforward  computations  show  that  CpK~1Cp  =  K~x  —  -^j/3(3T.  There¬ 
fore,  vTCTpK~1Cpv  =  vT K~1v  —  -JpjVT (3 f3T v  <  vTK~1v  for  any  v  G  Rn  and 
the  equality  holds  for  (3T v  =  0,  thus  proving  the  result. 

4.  The  result  follows  from  the  fact  that  7  =  Cp'y,  Cpl  =  0,  and  Rank/i^  =  n—1. 

5.  This  follows  from  the  definition  of  7  in  (3.4). 

6.  This  follows  from  the  definition  of  7  and  the  fact  that  Lp  1  =  0. 

7.  From 

\li  -  li I2  =  li  +$-  27i7i  <  2(7?  +  7,2)  <  2||7f  <  2e2 
and  7 i  —  7 j  =7 j  —  7 j  it  follows  that  \^i  —  7j|  <  \/2e.  Furthermore,  from 
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KLp'y  =  A'LP7  it  follows  that  ||A'Lp7||  <  ||  AT|| .|| Lp\\ .||7||  <  ne||AT||,  where  we 
used  the  fact  that  ||Ap||  <  n  and  equality  occurs  for  a  complete  graph,  that 
is,  for  p  =  [1,...,1]T. 

8.  Recall  the  fact  that  if  a  graph  is  connected  (p  G  Pc),  then  Lp  has  a  single 

eigenvalue  at  zero  associated  to  the  (right  and  left)  eigenvector  1,  and  the  rest 
of  the  eigenvalues  are  positive.  Let  L  be  a  representative  graph  Laplacian  of 
Lp  for  p  G  Pc.  Then,  there  is  a  unitary  matrix  U  =  [iq , . . . ,  un]  with  u\  =  1 

and  a  diagonal  matrix  A  =  diag[Ai,  A2, . . . ,  A„]  with  0  =  Ai  <  A2  <  •  •  •  <  A n 
such  that  L  =  UAUT.  For  any  v  G  Kn, 

n 

vT  Lv  =  Xi(uju)2 

i=  1 
n 

=  ^2xi(uju)2 

i—2 

n 

>  a2$»)2 

i= 2 
n 

=  A2^]«i/)2  -  A2«^)2 

i= 1 

=  \2vtv  -  A2^(lTz')2. 

To  compute  \2,m,  simply  observe  that  the  second  term  on  the  right-hand  side 
of  the  inequality  above  is  zero.  Therefore,  A2,m  is  the  minimum  A2  over  p  G  Pc. 
If  /3  ^  1,  a  standard  minimization  of  the  vector  function  vTu  —  i(lIV)2  with 
constraints  (3 Tv  =  0  and  vTv  =  1  yields  the  results.  Similarly,  it  can  be  shown 
that  A m  >  0.  Simple  numerical  computations  show  that  A2,m  =  A m. 

9.  Recall  that  the  graph  Laplacian  is  L  =  D  —  A.  Using  the  definitions  of  degree 
matrix  D  and  adjacency  matrix  A,  the  result  follows  easily. 

10.  Because  vl{ 7i,t)  is  bounded  and  Lipschitz,  \vL{"/i,t)  ~  vL{'Jj,t)\  <  2 vm  and 
Mt i,t)  -  <  l\7i  -  lj\  =  l\ii  -  lj\  <  V2l\m.  Then,  using 

i= 1  \i=1  aj 

where  aj  =  F’  it  is  easA  to  sh°w  that  ||£/3vl(7i  t)\\  <  v/2ni||'7||  and 

||jC/aVi,(7, t)\\  <  2^/nvM,  and  the  result  follows. 

Proof  of  Lemma  5.1.  First  we  show  that 

n 

(A.l)  I2  =  7tLpK2Lpj  <  n2k2M ||tI|2, 

i= 1 

where  vri  and  7  are  as  defined  in  (5.2)  and  (3.4),  respectively.  Denote  by  Lpp  the  itli 
column  (or  row)  of  Lp.  Then  vri  =  ktlfp^  and 

1^.  I2  =  khTkpllPi 

i  i 

=  7t  tfkvkpL 

i 

=  jT  LpK2  Lp^/ 

=  jTLPK2LPr 
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Now,  consider  n  PF  subsystems,  each  satisfying  Assumption  2.2,  and  let  (  =  [£»]nxi 
and  V\  =  Wi-  Using  (2.6),  (2.7),  and  (A.l)  yields 

tUllCII2  <Vi<  di||C||2, 

Vi  <  —  AiVi  +  p\n2 k2M\\^\\2  +  u\. 

Integrating  the  above  differential  inequality,  the  ISS  property  (5.6)  follows. 

Proof  of  Proposition  4.1  ( system  interconnection).  Define  V  =  V\  +  aV 2  for  some 
a  >  0  to  be  chosen  later.  Clearly,  V  satisfies  the  first  condition  of  (4.6)  for  some 
a  >  0,  a  >  0.  Next,  we  will  show  that  the  second  condition  is  also  satisfied.  Taking 
the  derivative  of  V  yields 


V<-(\i-  Ui  -a  (x2  -  V2+g\\d\\2, 

\  «1 /  V  aa2J 

where  g  =  max(l,a).  At  this  stage  assume  p\  and  p2  are  nonzero,  and  let 
(A. 2)  A0  =  A1-^  =  A2--^. 

Of  ^  CLOL  o 

Consider  the  case  where  A 2{t)  =  X2  >  0  is  constant.  If  p±p2  <  a1a2XiX2,  there 
exist  positive  numbers  Ao  and  a  satisfying  (A. 2).  As  a  consequence,  V  <  —  AoU  + 
5||d||2,  the  interconnected  system  is  ISS  with  input  d,  and  the  convergence  rate  is 
A  =  Ao- 

Consider  now  the  case  where  X2  ( t, )  is  not  constant  and  system  2  has  brief  instabil¬ 
ities  characterized  by  x(p)  and  A 2(t)  as  in  (4.3).  Using  the  same  Lyapunov  function 
V  =  Vi  +  aV 2  and  Ao  as  in  (A. 2),  compute  the  derivative  of  V  to  obtain 

V  <  —  XqV  +  a(X2  —  X2(t))V2  +  <?||d||“ 


that  yields 


J  -A0U  +  g\\d\\2,  x(p)  =0, 
1  (A3  -  X0)V  +  g  ||d||2,  x(p)  =  l, 


where  A3  :=  X2  +  X2.  Again,  Ao  exists  if  p\p2  <  a!a2^i^2-  Rewrite 
V  <  —XqV  +  a(X2  —  X 2(t))V2  +  g\\d\\ 


and  use  aV2  =  V  —  Vi  to  derive 

V  <  -(A0  -  A 3X(p))V  +  g\\d\\2, 

where  A3  :=  A2  +  A2.  Integrating  the  above  differential  inequalities,  it  is  easy  to  show 
that 


V(t)  <  V{t0)e~Xo{t~to)+X3Tp  +  5sup[t0jt]  ||d||2  f  e~Xo{t~T)+X3TpdT. 

Jt0 


This  yields 


V{t)  <  V{t.0)e~^Xo~aX3){t~to)+X3Ta 


eA  3Ta 


Copyright  ©  by  SIAM.  Unauthorized  reproduction  of  this  article  is  prohibited. 


260 


R.  GHABCHELOO  ET  AL. 


where  Ta  =  (1  —  a)To  if  the  system  has  brief  instabilities  as  defined  in  (3.3).  Therefore, 
the  interconnected  system  is  ISS  with  d  as  input  if  a  <  A0/A3. 

Suppose  now  that  p2  =  0  and  pi  >  0.  In  this  case,  the  interconnected  system 
takes  a  cascade  configuration  and  the  dynamics  of  system  2  are  reduced  to 

x(p)  =  0, 
x(p)  =  1, 


eA  3Ta 

+  A2-aA3SUP^l  4 

Using  the  above  inequality  together  with  (4.1)  and  (4.2)  it  is  easy  to  obtain 

Ui(f)  <  aie~Xlt  +  a2e-^-aX^  +  a3  sup[t0it]  ||d||2 

for  some  a.;  >  0,  *  =  1,2,3.  Therefore,  the  cascade  system  is  ISS  with  d  as  input  if 
a  <  A2/A3  and  the  convergence  rate  will  be  min(Ai,  A2  —  aA3). 

Proof  of  (5.15).  The  objective  is  to  make  Ao  >  0,  that  is,  Aa  —  C\l\/2n  >  0. 
Replacing  c3  =  \/  ck,M /km  hr  the  above  inequality  yields 


The  left-hand  side  of  the  inequality  takes  its  maximum  at 


TV  <  /  -A2V2  +  rf2, 
y2-\  A 2V2  +  dl 

whose  solution  takes  the  form 

V2(t)  <  U2(<o)e_(A2_aA3)(*-t o)+a3t- 


Aa  f0  ln  [lV2fif0  V  kM 


from  which  it  follows  that 


max  Aq  =  -  ln 


T0  l  elVZnT0  V  kM  ' 


To  make  Ao  positive  it  is  required  that 

1  I  km 
elT0  V  2 nk,M 

Using  T0  <  T  +  td  gives 


l 


1 

e(T  +  rD)\/2n ’ 


from  which  the  result  follows. 

Proof  of  Theorem  7.1.  PF  of  an  underactuated  AUV.  The  methodology  adopted 
for  PF  control  system  design  is  rooted  in  Lyapunov-based  and  backstepping  tech¬ 
niques.  The  exposition  that  follows  is  based  on  the  work  in  [2]. 

Step  1.  Define  the  global  diffeomorphic  coordinate  transformation 

e  :=  TT[p-Pd(7i)L 
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which  expresses  the  path  tracking  error  p  —  pf;  in  a  body- fixed  frame.  For  simplicity 
of  presentation,  we  will  for  the  most  part  drop  the  index  i  in  this  section.  Recall  the 
definition  of  speed  tracking  error  ??  =  7*  —  vr,  where  vr  is  a  reference  speed  profile. 
Recall  also  how  the  reference  speed  vr  is  decomposed  as  vr  =  Vl  +  vr,  where  the 
derivatives  of  Vl  are  known  but  those  of  vr  are  not.  The  derivative  of  e  yields 

e  =  -S(u)e  +  u-  vlRt p]  -  f]RT p], 

where  rj  :=  p  +  vr  (or  equivalently  7 i  =  Vl  +  fj)  and  superscript  7  stands  for  partial 

r)  2 

derivative  with  respect  to  7.  For  example,  p~{  =  and  pj  = 

We  define  the  Lyapunov  function  W\  :=  ^eTe  and  compute 
obtain 

Wi  =  eT(i/  -  vlRt p])  -  rjeTRT p], 

where  we  used  the  fact  that  eTS(cu)e  =  0  Ve,  u>  £  R3.  We  regard 
signal  and  introduce  the  virtual  control  tracking  error  variable 

z\  :=  v  —  VlRt p2  +  keM~1e. 

Then,  W\  can  be  rewritten  as 

W\  =  —  keeT  M~1e  +  eTZi  +  aifj, 

where  an  :=  — eTi?T pj.  Ideally,  in  the  absence  of  f)  one  would  like  to  drive  z\  to  zero 
so  as  to  render  W\  negative.  This  motivates  the  next  step. 

Step  2.  The  time  derivative  of  z\  yields 

Mil  =  hLrw  +  S(Mzi)oo  +  B\U\  +  fjhi  +  h  2, 


d2Pd 
dy2  ’ 

its  time  derivative  to 


v  as  a  virtual  control 


where 


T  :=  MS{RT pj)  -  S(MRT p]), 

hi  :=  -vlMRt p}'  -  vlMRT p]  -  keRT p], 

hi  :=  fv  +  +  vL hi. 

It  turns  out  that  due  to  lack  of  actuation,  it  is  not  always  possible  to  drive  z\  to 
zero.  Instead,  we  drive  z\  to  a  constant  design  vector  6  £  R3.  To  this  effect,  we  define 
a  new  error  vector  (f>  z\  —  S  and  the  augmented  Lyapunov  function 

W2  :=  Wi  +  ^(t>TM2, 

whose  derivative  is 

W2  =  —keeTM~1e  +  eTS  +  ct>TM{BC,  +  M~1e  +  h2)  +  a2r |, 
with  a2  :=  ai  +  (f>TMhi, 

B  :=  (  Bi  S(M6)  +  vLV  )  ,  and  <  := 
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where  we  used  the  fact  that  <f>T M S (M Zi)cj  =  (f>T M S (M S)u> .  Matrix  B  can  always  be 
made  full  rank;  see  [2]  for  details.  Let 

0i  :=  BT(BBT)~1(-h2  -  M-Xe  -  k^). 

To  complete  this  step,  we  set  u\  to  be  the  first  entry  of  (3\,  that  is,  u\  =  (  1  0iX3  )  0i, 
and  introduce  the  error  variable 

Z2  '■=  U)  —  H01,  n  :=  (  03x1  I3x3  ) 

that  should  be  driven  to  zero.  It  follows  that 

W2  =  —keeT M~1e  +  eTS  -  k^Mtft  +  <j>TMBTLTz2  +  a2fj. 

Step  3.  Let  0\  :=  h3  +  h4fj,  where  h3  collects  the  terms  in  0i  not  containing  fj. 
For  simplicity  we  do  not  expand  h3  and  h4.  Define 

W3  :=  W2  +  \z%Jz2, 

whose  time  derivative,  after  applying  the  control  law 

u2  =  Bi\-fu  +  JUh3  -  n BTM(t>  -  kzz2), 

yields 

(A. 3)  W3  =  —  keeTM~1e  +  eTS  —  k^cjFMcj)  —  kzz%Z2  +  a3  fj, 

where  a3  =  a2  —  dTI/14.  At  this  point  it  is  important  to  notice  that 

(A. 4)  \a3\  <  k\ |je||  +  k2\\(/)\\  +  h\\z2\\ 

2 

for  some  ki  >  0,  i  =  1,  2, 3,  that  are  functions  of  vl,  v^,  M,  p],  and  .  The  design 
phase  is  concluded  at  this  step  for  the  case  where  77  =  0  simply  by  making  7 j  =  vr. 
In  this  case,  fj  =  vr  and 

W3  <  -XW3  +  Pl\\S\\2  +  p2\vr\ 

for  some  A  >  0,  p\  >  0,  and  p2  >  0.  That  is,  the  PF  closed-loop  system  is  ISpS  with 
input  vr,  state  x3  =  (e,<f>,z2)T,  and  constant  pi  || A || 2 . 

Step  4.  This  extra  step  contemplates  the  situation  where  77  7^  0.  To  this  effect, 
augment  the  Lyapunov  function  W3  to  obtain 

W4  :=  W3  +  ^?72  =  ^eTe+  +  ^z%Jz2  + 

Set  the  feedback  law 

77  =  -a3  -  kvri 

to  make 

W4  =  —  keeTM~1e  —  k^^Mcj)  —  kzZ2Z2  —  k^p2  +  eT5  +  a3vr, 
which  can  be  rewritten  as 

(A. 5)  IT4  <  — AW4  +  pi||(5||2  +  /O2 1 'G7- 1 

for  some  A  >  0,  pi  >  0,  and  p2  >  0.  Again,  this  makes  the  closed-loop  system  ISpS 
with  input  vr,  state  x\  =  (e,  </>,  z2,  rj)T,  and  constant  pi||<5||2. 
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